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APPENDIX  A 


FLIGHT  SCENARIOS 


This  appendix  presents  the  six  flight  scenarios  and  conflicts  that 
were  used  in  the  simulator  cockpit  evaluation.  Each  scenario  consists  of 
a  nominal  flight  path  expected  for  a  flight  that  originates  at  the  Los 
Angeles  International  Airport  (LAX),  follows  a  standard  departure, 
establishes  itself  at  a  cruise  altitude,  changes  course,  and  returns  for 
an  approach  and  landing  at  LAX. 

Before  the  start  of  the  simulation  session,  the  crew  was  briefed  on 
the  entire  flight  route,  including  the  point  where  they  would  be  given 
clearance  to  return  to  LAX.  The  locations  and  types  of  conflicts  were 
not  presented  to  the  crew  before  the  start  of  the  experiment. 

The  crew  was  in  constant  communication  with  an  air  traffic  controller. 
Control  was  "passed"  from  clearance  delivery  to  the  tower,  to  departure 
control,  to  center,  to  approach  control,  and  finally  to  the  tower.  The 
nominal  clearances  given  to  the  pilots  during  each  scenario  are  presented 
in  this  appendix.  Clearances  sometimes  varied  due  to  differences  in  the 
way  that  the  simulator  was  flown. 

The  weather  was  kept  constant  for  the  departure,  en  route,  and  approach 
phases  of  flight  for  all  scenarios:  clear,  visibility  9  miles,  altimeter 
30.00.  Landing  conditions  varied  by  scenario. 

The  six  flight  scenarios  are  tabulated  in  Tables  A-l  through  A-6  and 
shown  graphically  in  Figures  A-l  through  A-6.  The  conflict  geometries  are 
illustrated  in  Figure  A-7  and  their  assignments  to  the  specific  scenarios 
are  listed  in  Table  A-7. 
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Is  BEST  quality 

j.0  DJ>C 


Tsblm  A-i.  SCENARIO  It  LOS  AMGELKS  TO  LAS  VEGAS 


(Aut*d  704  Claarad  as  fiiad,  Oaggate  4  Oapartura,  La  Vagas 
Transition,  Maintain  Plight  Laval  190.  Dtp Artur a  Frtqusncy 
12S.2.  Squawk  6115,  Otparturs  KuwAy  24R 


Crow  CaIIa  for  Takaoff 


"Cltarsd  for  TAkooff,  Maintain 
6000“ 


Siaulator  At  Short  Lint 


“Turn  Right  to  270  Conttet 
Otparturs  125.2" 


Conflict  Aj  intrudtr  on  7299, 
Blading  093,  Spttd  180  tlXS, 
Ottctnding  thru'tgh  Simulator  Ltvtl 
At  6000;  Turn  Simulator  to  CrtAtt 
Conflict 


“Turn  Ri$»t  to  060“ 


SiaulAtor  5  xiltt  Prior  to 
Crossing  V23 


“MAintAin  11000- 


Conflict  B:  mtrudtr  on  V201 
Bsading  189* ,  Spttd  250  BIAS, 
Ltvtl  At  11000)  SiaulAtor 
Climbing  to  11000. 


SiaulAtor  Midway  Bttw««n 
V201  And  V197 


SiaulAtor  12  Milts  Prior 
to  ttosaing  VL97 


Conflict  Ct  intrudtr  on  V197 
Htadlng  142*,  Spttd  320  KZAS, 
Otscsnding  through  19000 
SiaulAtor  Climbing  to  19000. 


SiaulAtor  Prior  to  Crossing 
6*  Radial  PCM 


Conflict  0i  Zntrudsr  on  180* 
Htadlng  Vsctor,  Sptsd  190  KIAS 
Ltvsl  At  14000)  SiaulAtor 
Otscsnding  to  14000,  Turn 
SiaulAtor  to  CrSAta  Conflict. 


Chtngs  to  Activs  Modo 


“MAintAin  PU90“ 


"ClAtrsd  to  LAX  Airport.  Prassnt 
Htadlng,  MAintAin  PL190,  Lot 
Angtlaa  Wttthtr:  Clttr,  9  Milts, 
Mind  230  st  11.  Altimtar  30.00“ 
"This  will  bt  sn  ILS  Approach  to 
Runway  24R“ 

"Raduct  Spssd  to  250  Snots" 


"Turn  Right  to  180  Otsctnd  and 
Maintain  14000“ 


11 

SiaulAtor  Crossing  7264 

"Turn  Right  to  220  Tsscand  and 
MaintAin  10000" 

12 

SiaulAtor  Intsrespts  2X8 
Runway  24R 

Rastora  Pull  Mods 

Conflict  C:  Intrudtr  on  I LS 
Runway  24R,  spssd  250  KIA8, 
Otscsnding  through  LCOOOj 
SiaulAtor  Ltvtl  tt  10000. 


Conflict  s  Rasolvtd 


Siatlaeor  25  Milts  from 
Touchdown 


Conflict  r :  Intrudtr  on 
Inesrcapt  to  SJ  Runway 
24 R  HtSding  220*  Spttd  210 
KXA8,  Ottctnding  through 
7000 ,  SiaulAtor  Ltvtl  At 
7000 

SiaulAtor  at  Tutor  Markar 


“Otsctnd  and  Maintain  7000” 

“Rtduct  Spttd  to  210  mots 
C It trad  ILS  Runway  24R  Approach 
Contact  To  war  120,3  at  ska  Tutor 
Marks r " 


“Claarad  to  Land.  R.uiway  24R 
'And  230  at  11“ 


Figure  A-2.  SCENARIO  1 


Table  4-7.  SCXHARXO  2,  LOS  ANGELES  TO  SAN  DIEGO 

United  ?04  Cleared  as  filed,  Maintain  4000,  Maintain  Runway 
Heading,  Expect  16000  lq  Mile*  South  of  SLX,  Departure  fre¬ 
quency  129.2.  Squawk  6127,  Departure  Runway  6L 


ifQunci 

MUXltJL 


"CLEARANCE  "/ACTION 


Crew  Calle  for  Takaoff 


"Cleared  for  Takeoff.  Runway 
6L,  Maintain  Runway  Heading, 
Maintain  4000" 


Simulator  Airborne 


‘Contact  Departura" 


Conflict  At  Intruder  on  US 
Course  Heading  Toward 
Simulator,  Speed  230  KZAS. 
Level  at  4000 i  Simulator 
Climbing  to  4000 


Conflict  A  •aaolved 


Conflict  S:  Intruder  on  V-8-21 
Heading  238* ,  Speed  250  KZAS, 
Descending  through  13000: 
Simulator  Climbing  to  13000 

Simulator  5  Miles  on  si,x 
148*  Radial 


"Turn  Right,  Direct  SLZ,  Depart 
SLX  on  148*  Radial  to  Intercept 
V25,  Climb  and  Maintain  13000, 
Maintain  250  Shots  in  Climb" 


Clangs  to  Activa  Mode 


Simulator  10  Mile#  o<t  SLZ 
148*  Radial 

Conflict  Ci  Intruder  on  V25 
Heading  123*,  Spaed  340  KIAS, 
Descending  through  16000; 
Simulator  Climbing  to  16000 


Simulator  45  Miles  on  LAX 
123*  Radial 


Simulator  SO  milas  on  LAX 
123*  Radial 


Conflict  0:  Intruder  on  V23 
Heading  300*,  Speed  250  K1AS, 
Descending  through  16000; 
Simulator  Level  at  16000 

Conflict  D  Resolved 


Conflict  E:  Intruder  on  V23 
Programmed  to  Turn  to  320  at 
SLZ.  Speed  160  KZAS,  Level  at 
7000;  Simulator  Oeecending  to 
*oco 


"Climb  and  Maintain  1600C " 


"Cleared  LAX  Airport,  Maintain 
16000,  Present  Heading  for 
Radar  Vectors  to  ILS  Runway 
24R,  LAX  Weather  Clear,  9  Milas, 
wind  220  at  15,  Altimeter  30.00" 


"Turn  Left  to  360;  Intercept 
V23  to  5LX.  Reduce  Speed  to 
250  Knots" 


"Descend  and  Maintain  7000" 
Restore  full  Mode 


Simulator  at  SLX 


"Depart  3LX ,  Heading  32C , 
Ceecend  to  3000,  Raduce 
Speed  to  180  mots" 


Simulator  1  Mila  from 
ILS  Localizer  Runway 
24? 


"Turn  Left  to  290.  Maintain 
3000  Until  Localizer,  Cleared 
ILS  24R  Approach,  Contact 
Tower  120.3  at  Dueer  Marker 


Conflict  ?:  In trader  >n 
Intercept  to  ILS  Runway 
24R.  Heading  100.  Speed 
160  :<nots .  lescending 
Along  Hide  Slope; 
Simulator  lescending 
Along  Slid*  Slope 

Simulator  at  Cuter  Marks r 


'Cleared  to  Land,  Runway 
24R.  Wind  32 Z  it  -! 
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Figure  A-2.  SCENARIO 
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Table  A-J .  SCENARIO  3:  LOS  ANGELES  TO  BAKERSFIELD 

CLEARANCE:  United  704  Cleared  «•  filed,  Consul  4  Departure,  Bakersfield 

Transition,  Maintain  flight  Level  180,  Departure  frequency  125.2, 
Squawk  6134.  Departure  Runway  2SL 


SEQUENCE 

NUMBER 


(Drew  Calls  for  Takeoff 


Simulator  Airborne 

Conflict  A i  Intruder  South 
of  LAX  Reading  360*,  Speed 
200  KIAS,  Descending  through 

8000 1  s Laul*toe  is  climbing 
to  18000. 

Conflict  A  Resolved 


'CLEARANCE "/ACTION 

'Runway  2 SI,  Cleared  for  Take¬ 
off,  Croesing  the  Shore  Line, 
fly  Heading  270' 

“Contact  Departure  Control" 


"Maintain  8000,  Turn  Right 
to  060* 


Simulator  Established  on  060 


Sioulator  2  Milas  Prior  to 
Crossing  V23 


Conflict  B:  Intruder  on  VS 18 
Heading  087,  Speed  340  KIAS, 
Intruder  Level  at  ISOOO; 
Sioulator  Climbing  to  18000. 

Conflict  B  Resolved 

Conflict  C:  Intruder  on  72 3 
Heading  143*,  Speed  2?o  KIAS, 
Descending  through  1800C,- 
Sloulaeor  Level  et  18000. 

Conflict  C  Resolved 


Simulator  at  GMN 


Conflict  D:  Intruder  on 
7299,  Reading  167*,  Spaed 
250  KIAS.  Descending  through 
18000;  Simulator  Laval  at 
18000 . 


Conflict  0  Rasolvad 


Simulator  at  FZM 


Conflict  E:  Intruder  on  ?im 
ISa*  Radial,  Speed  iso  KIAS, 
Level  at  3000 j  Simulator 
Descending  to  5000. 


"Maintain  10000" 

"Turn  Left  to  350  Intercepting 
'723  on  Course,  Climb  and 
Maintain  fL180" 


Change  to  Active  Mode 


"Turn  Left  to  290  for 
Clearance  to  LAX  Airport" 


"Cleared  to  LAX  Airport. 

Maintain  FL190,  Radar 
Vectors  to  GMN,  Intercept  7299.  Los 
Angeles,  Weather:  Clear,  9  miles, 
wind  080  at  11,  Altimater  3C.00, 

ILS  Runway  6L" 

"Reduce  Speed  to  250  Oiots" 


"Descend  and  Maintain  12000 , 
Depart  7124  on  the  TIM  158* 
Radial" 

"Descend  and  Maintain  5000" 
Restore  full  Mode 


Conflict  S  Resolved 


Sioulator  3  Miles  Prior 
to  Localizer  Runway  SL 


"Reduce  Speed  to  130  Riots" 


"Turn  Left  to  390  Intercept 
Localizer,  Maintain  5000  to 
Clide  Slops.  Cleared  ILS 
Runway  5L  Approach.  lontact 
Tow#r  se  jam.  120.3 


Conflict  f:  intruder  on 
Intercept  to  Runway  SL, 
Heading  043.  Spaed  130  KIAS. 
Descending  Along  Clide  Slope: 
Simulator  Descending  Along 
Clide  3lope 


“Cleared  to  Land.  Runway 
-L.  Wind  28C  it  11” 
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Table  A-4.  SCENARIO  4:  LOS  ANGELES 

TO  LAS  VEGAS 

CLEARANCEj 

United  704  Cleared  at  filed,  Maintain  Flight  Level  190, 

Departure  frequency  125.2,  Squawk  4144,  Departure  Runway  7r 

stQutncz 

MUNI  at 

EVENT 

-CLEARANCE "/ACT ION 

i 

Crew  calls  for  Takeoff 

"Cleared  for  Takeoff  '‘unway  7R 
Maintain  Runway  Heading" 

2 

Simulator  Airborne 

"Contact  Departure  Control" 

3 

Simulator  4  Miles  from 

LAX  VOR 

"Turn  Left  to  300" 

4 

Simulator  Established  on 

300  Heading 

"Intercept  V165  on  Course" 

3 

Conflict  A<  Intruder  on  V201, 

Heading  199*,  Speed  120  KIAS, 
Descending  to  5000  from  HOOOi 
Simulator  Climbing  to  FL180 . 

6 

Conflict  •:  Intruder  Croasing 

V16S ,  Beading  072,  Speed  250 

KIAS,  Level  at  18000;  Simula¬ 
tor  climbing  to  18000 

7 

Conflict  8  Resolved 

"Intercept  VS18  on  Course", 

Change  to  Active  Mode 

9 

Simulator  10  Miles  S*  of  phd 

"Depart  PHD  on  the  040  Radial 
for  Radar  vactora  to  LAX". 

9 

Conflict  C:  Intruder  Inter¬ 
cepting  V201  at  7M0,  Haeding 

189* .  Speed  360  KIAS ,  Descend¬ 
ing  through  3 3DDO;  Simulator 

Level  at  18000 

10 

Conflict  C  Resolved,  Simulator 
Heading  Past  PMD  for  Vectors 

Sack  to  LAX 

-Cleared  to  LAX  Airport,  PHD, 

V197,  PCM,  Depart  POM  Heading 
190*,  Radar  Vectors  to  ILS 

Runway  25L,  Maintain  FL180, 

Reduce  Speed  to  250  Knots" 

11 

Conflict  Ds  Intruder  on  V197, 
Heading  148*,  Speed  340  KIAS. 
Descending  through  18000; 

Simulator  Laval  at  18000 

12 

Conflict  0  Resolved 

"Descend  and  Maintain  10000" 
Restore  full  Mode 

13 

Conflict  E:  Intruder  on  7197 

Heading  143*,  Speed  110  KIAS, 

Level  ae  10000:  Simulator 

Descending  to  10000 

14 

Conflict  S  Resolved 

"Descend  and  Maintain  6000, 

Croes  PCM  at  7000" 

IS 

Simulator  1  Mila  MW  POM 

"Reduce  Speed  to  180  Riots. 

Depart  POM  Heading  190  * 

Simulator  1  Mile  3W  PCM 

"Turn  Right  to  220 ,  Intercept 
Localixer,  Maintain  4000  to 

Qlida  Slope,  Cleared  US  Runway 
25L  Approach,  Contact  Tower  at 
Outer  Marker,  120.9 

17 

Conflict  F:  Intruder  to 

Intercept  2SR,  Heading  220 
to  Localizer  Speed  180  KIAS 
Simulator  Descending  Along 

Slide  Scope 

19 

Simulator  at  Cuter  Marker 

"Cleared  to  Land.  Runway  I5L 

Kind  250  at  3" 

Figure  A-4.  SCENARIO  4 
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Tahl*  A-i.  SCENARIO  5.  LOS  ANGELES  TO  SANTA  BARBAJU 

CLEARANCE:  United  704  Cleared  a*  riled,  Ventura  3  Departure, 

Sente  Serbere  Transition,  Maintain  14000 .  Departure 
frequency  123.2,  Squawk  6132,  Deperture  Runway  7 A 

SEQUENCE 

NUMBER 

EVENT 

“CLEARANCE  "/ACT  ION  j|| 

1 

Crew  calls  (or  takeoff 

"Cleared  for  Takeoff,  Runway 

7r,  Maintain  4C00 

2 

Simulator  Airborne 

"Contact  Departure  Control" 

3 

Simulator  3  Miles  NS  of 

Airport 

"Turn  Right  to  240" 

4 

Conflict  A>  Intruder  on  V201, 
Heeding  012*,  Speed  230  WAS, 
Descending  through  4000) 
Simulator  Level  at  4000 

3 

Simulator  3  Milas  Past  V201 

"Climb  and  Maintain  14000, 

Turn  Right  to  265,  Intercept 

V2S  on  Course" 

6 

Conflict  is  Intruder  Per* 
pendicuiar  to  Simulator 

Course,  Heading  175* 

Speed  250  £XA*.  Level  at 

9000)  Simulator  climbing 
to  14000 

7 

Simulator  10  Milas  S£  of 
xweng  Intersection 

"Continue  Present  Heading, 

Maintain  14000,  Radar  Vectors 
to  US  Runway,  6L  Los  Angelas 
weather:  Clear,  9  Mile  Visibility 
wind  060  at  9,  Altimeter  30.00" 
c  Clangs  to  Active  Mode 

8 

Conflict  C:  Intruder  on  109* 
Heading  Between  VI2S  and  V25, 
Speed  300  WAS,  Descending 
through  14000  >  Simulator  Level 
at  14000.  Turn  Simulator 
to  Create  Conflict 

"Turn  Right  to  040" 

9 

Conflict  C  Resolved 

"Turn  Right  to  Intercept 

V12S  on  Course  to  T tM" 

10 

Conflict  0:  Intruder  on  V12S, 
Heading  087*,  Speed  340  JOAS, 
Descending  through  14000) 
Simulator  Level  at  14000 

11 

Conflict  0  Resolved 

"Depart  PIM  on  she  ?IM 

158*  Radial" 

12 

Simulator  13  Miles  5E  of  rw 

"Descend  and  Maintain  3000" 

Restore  full  Mode 

13 

Conflict  E:  Intruder  on  rw 

138*  Radial,  Speed  100  KXAS, 

Level  at  3000  j  Simulator 
Descending  to  3000 

14 

Simulator  3  Mti#s  Prom  Its 
Localizer  Runway  8L 

"Turn  Left  to  090,  intercept 
Localizer,  Maintain  3C00  to 

Glide  Slope,  Cleared  US 

Runway  6L  Approach,  Contact 

Tovar  ae  Ouppi.  120.3 

15 

Conflict  T:  Intruder 

Intercepting  Localizer  for 

6S.  Heading  228* ,  3caed  180 

K1AS,  Descending  Along  Glide 

Slope)  Simulator  Deseanding 

Along  Clide  Slope 

16 

Simulator  at  3appi 

“Clearad  to  Land.  Runway  5L 
wind  060  at  3" 

A-10 


Tsbl*  A-6.  SCENARIO  ot  ICS  ANGELES 

TO  SAN  DIEGO 

CLEARANCE:  United  704  Claarad  U  Fiiad,  Maintain  14000. 

Maintain  Runway  Haading,  Oapartura  Fraquancy  125.2 
sguawk  6145,  Oapartura  Runway  25L. 

SEQUENCE 

NUMBER 

EVENT 

“CLEARANCE  “/ACTION 

1 

Craw  Calls  Cor  TaXaoCf 

"Claarad  for  Takaoff  Runway  25L 
Maintain  4000" 

2 

Simulator  Airbccna 

"Contact  Dapartura  Control" 

3 

Conflict  As  Intrudar  on  V201 
a aiding  012,  Spaad  140  XIAS, 

Laval  at  5000 i  Simulator  Laval 
at  4000,  Climfi  and  Turn  to 
tut 

"Turn  La ft  to  090,  Climb 
and  Maintain  14000" 

4 

Conflict  A  Raaolvad 

"Intracapt  725  on  Coursa, 

Do  Not  Exes ad  340  Knots" 

5 

Simulator  Intarcapts  V25 

Changa  to  Activa  Mo da 

6 

Conflict  •:  Intrudar  an  V25, 
Haading  123*.  Spaad  390  JUAS, 
Dascandlng  through  14000 j 
Simulator  Laval  at  14000 

7 

Conflict  B  Raaolvad 

"Raduca  Spaad  to  250  Knots, 

This  will  ba  Radar  '/actors  to 

LAX  Airport  for  ZL3  Runway  4L. 
Claarad  LAX  Airport.  Maintain 
14000,  Radar  7 actors ,  SLZ  120* 
Radial  Oiract  SLX,  SLI  251* 
Radial,  Radar  Vactors  to  CLS 
Runway  6L“ . 

9 

Simulator  2$  Milas  SE  SLr 

-Turn  Utt  to  J60* 

9 

Simulator  2  Milas  Prior  to 
Crossing  723 

"Turn  Laft  to  330.  intarcapc 

SLI  120*  Radial.  Diract  SLI 

13 

Conflict  C;  Intrudar  Par- 
pandicular  to  723,  Haading  0  30, 
Spaad  250  XXAS,  Cascading 
through  14000:  Simulator  Laval 
at  14000 

11 

Conflict  C  Raaolvad 

Rastora  Full  Mo da 
"Cascand  and  Maintain  3000" 

12 

Conflict  0:  Intrudar  on  73-44, 
Haading  251*.  Spaad  130  KIAS. 
Laval  at  12000:  Simulator 
Dascandlng  to  3000 

13 

Conflict  E:  intrudar  on  78-54 , 
Haading  371* ,  Spaad  2 So  XI AS, 
Casca  tiding  to  8000,  Simulator 
Catcanding  to  9000 

14 

Conflict  2  Raaolvad 

"Turn  Right  to  320 .  Raduca 

Spaad  to  180  frets,  Daseand 
and  Maintain  40C0 

15 

Conflict  7:  intrudar  on  ILS 
Localizar  4L,  Spaad  190  X2AS, 
Dascandlng  Along  Gilds  Slop#: 
Simulator  Laval  at  400c 

"Turn  Right  to  330*  Maintain 

4000  to  Localizar ,  Claarad 

CLS  Runway  si  Approach. 

Contact  Towar  120.3  at  iu;?: 

id 

Simulator  at  Guppi 

"Claarad  to  land  Runway  *1 

Wind  C65  at  3" 

hjft  tin'M*',?- 
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APPENDIX  B 


SUBJECT  PILOT  ADVANCE  BRIEFING 


This  appendix  consists  of  the  briefing  material  and  cover  letter 
which  were  mailed  to  the  subject  pilots  several  weeks  before  the  testing. 
The  briefing  includes  information  on  the  Aircraft  Separation  Assurance 
(ASA)  concepts,  program  objectives,  test  bed  set-up,  ASA  displays  and 
testing  procedures.  A  Federal  Aviation  Administration  (FAA)  review  cycle 
took  place  after  this  mailing  and  resulted  in  minor  changes  to  the  program. 
These  changes  were  provided  to  the  subject  pilots  during  the  pre-briefing 
held  befbre  each  simulator  session  (see  Appendix  C) . 
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November  22,  1978 
S4 ASP/G&  CSD— 7  8-163 
W.  0.  13^3-01 


Dear  Sir: 

The  attached  Aircraft  Separation  Assurance  System  Participa¬ 
tion  Briefing  Sheet  is  provided  to  assist  you  in  preparation  for 
your  upcoming  participation  in  the  ASA  system  evaluation.  The 
briefing  sheet  is  designed  to  provide  more  information  on  the  ASA 
displays  and  experiment  than  was  given  in  my  original  letter. 

The  experiment  times  have  been  changed  for  the  better.  Simula¬ 
tion  periods  will  start  at  8  p.m.  each  day  and  the  last  period  will 
be  completed  at  about  midnight. 

When  you  arrive  in  Denver,  please  contact  the  ARINC  Research 
Corporation  office  at  398-5300.  This  phone  will  be  manned  after 
1  p.m.  each  week  day.  Upon  contact  you  will  be  assigned  a  report¬ 
ing  time  of  either  7  p.m.  or  9  p.m.  There  is  approximately  a  one 
hour  briefing  prior  to  starting  the  simulation  run  and  there  will 
be  about  a  ^5  minute  debriefing  at  the  conclusion  of  the  period. 

Directions  to  the  briefing  room  will  be  posted  in  the  crew 
lounge  on  the  first  floor  of  the  main  building  at  the  United  Plight 
Training  Center. 

We  appreciate  your  participation  in  this  program.  If  you  have 
any  problems  with  the  scheduled  date  already  assigned  to  you, 
please  advise  me  as  soon  as  possible. 

Sincerely , 

Thomas  P.  Berry 

Project  Engineer 


Enc 

TPB : la 
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ASA  COCKPIT  EVALUATION 


PARTICIPANT  BRIEFING  SHEET 


BACKGROUND 

The  aviation  industry  and  the  FAA  have  been  deeply  involved  in  the 
development  of  airborne  collision  avoidance  systems  since  the  late  1950' s. 
The  major  thrust  of  these  efforts  has  been  directed  toward  solution  of  the 
technical  problems  inherent  in  complex  electronic  systems.  Considerable 
effort  has  also  been  directed  toward  defining  the  operational  problems  that 
may  arise  with  the  implementation  of  a  collision  avoidance  system.  These 
operational  problems  affect  both  the  users  of  the  airspace  (aircraft)  and 
those  respt  nsible  for  maintaining  an  orderly  and  safe  flow  of  traffic  (The 
Air  Traffic  Control  (ATC)  System).  The  concept  that  incorporates  these 
components;  Aircraft,  ATC  System,  and  Collision  Avoidance  System,  is  gener¬ 
ally  called  Aircraft  Separation  Assurance  (ASA). 

The  Aircraft  Separation  Assurance  concept  incorporates  the  following 
basic  principles: 

.  The  Air  Traffic  Control  System  is  responsible  for  the  separation 
of  controlled  traffic  within  controlled  airspace. 

The  pilot  is  responsible  for  the  safety  of  his  aircraft. 

.  The  Collision  Avoidance  System  is  responsible  for  providing 
safety  benefits  to  each  user  who  installs  the  equipment,  i.e. , 
the  system  should  provide  the  user  immediate  protection  against 
other  aircraft  even  if  they  are  not  carrying  the  system. 

The  currently  envisioned  ASA  system  will  monitor  the  interrogations 
and  replies  of  the  secondary  radar  (transponders)  to  determine  the  relative 
position  and  closure  rate  between  the  aircraft  in  which  it  is  installed 
and  other  aircraft. 

Because  the  ASA  concept  involves  both  hardware  (Collision  Avoidance 
Displays  and  Logic)  and  procedures,  it  is  necessary  to  gather  information 
on  the  system's  acceptability  by  the  users  during  development.  The  Federal 
Aviation  Administration  is  conducting  a  series  of  studies  and  experiments  to 
gather  the  reactions  to  the  ASA  concept  by  controllers ,  general  aviation 
pilots  and  air  carrier  pilots.  This  phase  of  the  project  is  dedicated  to 
gathering  the  opinions  and  reactions  of  air  carrier  pilots  to  the  ASA  con¬ 
cept. 


OBJECTIVES  OF  THE  PROGRAM 

The  primary  objective  of  the  cockpit  evaluation  of  Aircraft  Separation 
Assurance  concepts  is  to  evaluate  the  operational  impact  of  the  introduction 
of  ASA  systems  in  commercial  air  carrier  aircraft. 

To  meet  this  objective,  an  airline  cockpit  simulator,  modified  by  the 
addition  of  ASA  display  devices,  will  be  flcwn  by  air  carrier  line  crews 
through  realistic  flight  sequences.  In  addition  to  the  events  that  normally 
occur  during  a  routine  flight,  a  number  of  traffic  conflicts,  undetected  by 
ATC,  will  be  introduced.  The  flight  crew  responses  to  these  conflicts  will 
be  observed  and  measured. 

Each  flight  crew  will  fly  three  short  flights  during  a  two  hour  simula¬ 
tion  session.  Each  flight  will  use  a  different  ASA  display  concept  for 
presentation  of  information  on  conflicting  aircraft. 

TEST  EQUIPMENT  AND  SETUP 

The  simulator  cockpit  represents  a  United  Airlines  Boeing  727-222  air¬ 
craft.  The  simulator,  built  by  Singer-Link,  is  a  high-fidelity  system 
that  includes  a  motion  base  and  is  similar  to  most  727  cockpit  simulators. 

The  cockpit  visual  system  is  a  computer-generated  two-window  night  scene. 

For  this  test,  the  visual  system  will  be  programmed  to  depict  the  Los  Angeles 
area  and  the  departure  and  arrival  airport  will  be  the  Los  Angeles  Inter¬ 
national  Airport.  The  visual  system  reproduces  a  night  scene  with  a  high 
degree  of  fidelity,  however,  only  the  forward  view  is  available.  The  visual 
system  also  has  the  capability  to  depict  other  aircraft  in  flight. 

The  simulator  cockpit  will  be  modified  by  installation  of  three  ASA  dis¬ 
plays.  One  display  is  an  Instantaneous  Vertical  Speed  Indicator  (IVSI), 
modified  to  allow  presentation  of  ASA  commands.  This  instrument,  shown  in 
Figure  1,  provides  normal  rate  of  climb  information  and  indicates  ASA  commands 
by  illuminating  portions  of  the  dial  face.  The  second  display,  shown  in 
Figure  2 ,  is  an  alphanumeric  display  that  uses  a  matrix  of  light  emitting 
diodes  (LEDs)  to  present  ASA  advisories  and  commands  in  a  combined  alpha¬ 
numeric  and  symbolic  format.  The  display  provides  traffic  position  information 
for  as  many  as  four  aircraft.  When  an  aircraft  poses  a  collision  threat,  the 
position  of  that  aircraft  is  shown  along  with  an  appropriate  command  which 
will  assist  the  pilot  in  avoiding  the  collision. 

The  third  display,  shown  in  Figure  3,  is  a  cathode  ray  tube  (CRT)  that 
symbolically  displays  the  relative  location  track  and  MSL  altitude  of  other 
aircraft,  indicates  which  of  the  displayed  aircraft  is  in  conflict  with  your 
aircraft,  and  displays  appropriate  commands  for  resolution  of  the  conflict. 

Figures  4,  5  and  6  show  the  location  of  the  displays  on  the  Captain's, 
First  Officer's  and  center  console  panels.  Each  crew  member  will  have  an  IVSI 
and  LED  display.  The  CRT  display  is  located  on  the  center  console  in  the 
space  normally  occupied  by  the  weather  radar  indicator. 
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FIGURE  1 

ASA  MODIFIED  INSTANTANEOUS  VERTICAL 
SPEED  INDICATOR  (IVSI) 


K-f> 


FIGURE  3 

CATHODE  RAY  TUBE  (CRT)  DISPLAY 
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ASA  COMMANDS 

The  ASA  commands  fall  into  three  categories;  Limited  Vertical,  Negative 
and  Positive.  Limted  vertical  commands  are  the  least  restrictive  and  attempt 
to  limit  vertical  maneuvers  (CLIMB  or  DESCENT)  to  2000,  1000,  or  500  FPM  as 
the  situation  permits.  Negative  commands  restrict  the  aircraft  from  performing 
specific  horizontal  or  vertical  maneuvers  (DON'T  CLIMB,  DON'T  DESCEND,  DON'T 
TURN  RIGHT,  DON'T  TURN  LEFT).  Positive  commands  are  issued  as  a  last  resort 
and  indicate  that  the  pilot  must  maneuver  to  avoid  a  collision  (CLIMB,  DESCEND, 
TURN  RIGHT,  TURN  LEFT) .  These  commands  are  presented  sufficiently  early  so 
that  the  pilot  can  respond  with  standard  rate  turns  or  standard  climb/descent 
rates.  Maneuvers  should  be  executed  until  the  command  is  deleted  from  the  ASA 
display.  If  significant  deviations  from  the  nominal  flight  path  occur,  ATC 
should  be  notified. 

DISPLAYS 

The  modified  Instantaneous  Vertical  Speed  Indicator  (IVSI)  combines  two 
functions.  It  operates  identically  to  a  standard  IVSI  and  also  displays  ASA 
commands.  The  instrument,  shown  in  Figure  7,  has  no  additional  controls. 

The  only  adjustment  available  is  that  of  the  panel  light  control,  located  on 
the  overhead  panel,  which  varies  the  intensity  of  the  light  on  the  face  of  the 
instrument.  The  intensity  of  the  ASA  command  lights  are  fixed.  The  limited 
vertical  commands  are  displayed  as  yellow  lighted  arc  segments  outside  the 
numbers,  adjacent  to  the  outside  edge  of  the  instrument  face.  When  a  limited 
vertical  command  is  presented,  either  one,  two,  or  three  of  these  arc  segments 
will  be  lighted  to  indicate  the  maximum  climb  or  dive  rate.  To  avoid  a  conflict, 
the  rate  of  climb  needle  should  not  enter  a  lighted  arc  segment. 

All  other  commands  are  easily  understood.  "No  left"  and  "no  right"  turn 
r ommands  are  shown  by  lighting  the  appropriate  indicator  at  the  lower  corners 
of  the  instrument  case.  Commands  to  "climb”,  "dive",  turn  "left"  or  "right" 
are  shown  by  lighting  the  appropriate  red  arrow  in  the  center  of  the  instrument 
face.  These  commands  are  lighted  only  when  the  system  senses  an  imminent 
collision. 

The  Light  Emitting  Diode  (LED)  display,  is  a  special  display  constructed 
bv  Litton  Aero  Products  for  this  test.  The  display  panel  consists  of  more 
than  2200  light  points  that  can  be  lighted  red,  green  or  a  combination  of 
both  colors  (orange).  Messages  are  formed  by  turning  on  the  appropriate  LEDs 
to  form  the  desired  letter,  number  or  symbol.  Traffic  advisories  and  ASA 
commands  are  shown  as  messages  of  one  or  more  lines.  Traffic  advisories  are 
displayed  in  green,  limited  vertical  and  negative  commands  are  displayed  in 
orange,  and  positive  commands  are  displayed  in  red.  Ihe  format  for  traffic 
advisories  is  identical  to  current  ATC  voice  traffic  advisories.  An  example 
of  the  display  format  is  shown  in  Figure  8. 

Limited  vertical  and  negative  commands  are  displayed  as  alphanumeric 
messages  in  orange.  These  commands  are  shown  in  Figure  9.  Each  command 
occupies  two  lines  at  the  bottom  of  the  display.  Whenever  either  of  these 
types  are  displayed,  a  traffic  advisory  of  the  aircraft  generating  the 
command  will  be  given  on  the  top  line. 
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Limit  Climb 
Command  Lights 


COMMAND 

MEANING 

COMMAND 

MEANING 

DON'T 

TURN  RIGHT 

Self  Explanatory 

MX  DESCENT 

500 

Do  not  descend 

More  than  500  FPM 

1 

DON'T 

TURN  LEFT 

Self  Explanatory 

MX  CLIMB 

1000 

Do  not  climb 

More  than  1000  FPM  | 

DON'T 

CLIMB 

Self  Explanatory 

MX  DESCENT 

1000 

j 

Do  not  descend  | 

Mere  than  1000  FPM 

l 

I 

DON'T 

DESCEND 

Self  Explanatory 

MX  CLIMB 

2000 

1 

1 

Do  not  climb  j 

More  than  2000  FPM  j 

MX  CLIMB 

500 

Do  not  climb 

More  than  500  FPM 

, 

MX  DESCENT 

2000 

i 

Do  not  descend 

More  than  2000  FPM 

FIGURE  9 

LED  Negative  and  Limited  Vertical  commands 
(ORANGE  LETTERS) 


Positive  comnands  are  displayed  as  a  combined  alphabetic  and  symbolic 
command.  Each  of  these  commands,  illustrated  in  Figure  10  occupies  two  lines 
at  the  bottom  of  the  display.  Whenever  a  positive  commands  is  displayed, 
a  traffic  advisory  of  the  aircraft  generating  the  command  will  be  given  on 
the  top  line. 


COMMAND 


I  I  1 


1  i  1 


MEANING 


FIGURE  10 


LED  Positive 


The  Cathode  Ray  Tube  (CRT)  display,  shown  in  Figure  3,  is  a  standard 
type  CRT  display  adopted  for  use  in  this  experiment.  It  displays  the 
position  of  other  traffic  in  relation  to  your  own  aircraft,  which  is  always 
in  the  center  of  the  display.  The  display  is  oriented  with  your  aircraft 
heading  up.  Symbology  used  on  the  CRT  display  is  shown  in  Figure  11. 


ASA  commands  are  displayed  at  the  bottom  of  the  display.  Limited 
vertical  and  negative  commands  are  displayed  in  the  same  form  as  shown  in 
Figure  9.  Collision  avoidance  commands,  "Turn  Left",  "Turn  Right",  "Climb" 
and  "Dive"  are  self-explanatory. 

The  CRT  display  is  overlayed  with  two  range  rings.  The  inner  range 
ring  represents  a  distance  of  three  (3)  miles  from  your  own  aircraft,  the 
second  ring  is  six  (6)  miles  from  your  own  aircraft,  and  the  top  of  the 
display  is  approximately  nine  (9)  miles  from  your  own  aircraft. 
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On  the  IVSI  display  there  is  no  change  in  the  method  of  presenting 
maneuver  commands  or  limit  commands.  No  method  is  provided  to  alert  the 
pilot  when  the  system  is  operating  in  “Active"  mode,  and  the  pilot's  reaction 
to  commands  should  be  the  same  as  with  the  full  system. 

The  LED  display  does  not  specifically  notify  the  pilot  when  operating 
in  "Active"  mode  either;  however,  "Active"  mode  operation  can  be  detected  by 
the  absence  of  relative  position  and  direction  of  movement  from  traffic 
advisory  messages.  All  maneuver  limit  and  command  message  formats  are  iden¬ 
tical  to  those  shown  in  Figures  9  and  10.  Traffic  advisories  are  in  the  format 
shown  in  Figure  12  as  compared  to  Figure  8. 

When  operating  in  the  "Active"  mode,  the  CRT  display  format  is  completely 
changed.  An  example  of  this  format  is  shown  in  Figure  13.  No  symbology  is 
used  for  "Active"  mode  CRT  display.  The  display  provides  range  and  altitude 
of  intruder  aircraft  and  alphanumeric  limit  and  maneuver  commands. 


Figure  12.  LED  TRAFFIC  ADVISORY  FORMAT  "ACTIVE"  MODE 


(Green  letters) 


FIGURE  13.  CRT  "ACTIVE"  MODE  DISPLAY 
WITH  EXAMPLE  COMMAND 


Logic 

The  ASA  system  uses  the  electronic  signals  associated  with  the  ATCRBS 
(transponder)  system  to  determine  the  relative  position  of  other  aircraft. 
While  the  ASA  system  can  utilize  the  signals  from  current  transponders,  it 
is  a  new  and  completely  separate  system,  not  merely  an  add-on  to  your  present 
transponder.  Full-service  ASA  will  require  modification  of  the  ground  radars 
in  the  FAA  system  to  provide  timing  signals  for  use  in  determining  the  bear¬ 
ing  to  other  aircraft. 

The  ASA  system,  using  only  the  replies  from  existing  transponders, 
determines  the  range  to  another  aircraft.  Hie  altitude  of  other  aircraft 
is  also  determined  from  the  transponder  reply.  After  performing  a  quality 
check  to  eliminate  randcm  signals,  the  ASA  logic  starts  to  track  replies 
from  other  aircraft  that  are  within  a  specified  distance  (horizontally  and 
vertically)  from  your  own  aircraft.  By  making  a  series  of  range  measure¬ 
ments,  the  system  determines  whether  the  two  aircraft  are  closing  or 
separating,  and  if  closing,  the  rate  of  closure.  When  the  projected  minimum 
distance  between  the  aircraft  reaches  a  preset  value,  or  the  closure  rate 
reaches  a  preset  value,  the  system  logic  will  select  either  a  maneuver 
limit  command,  e.g.,  "Don't  turn  left,"  "Maximum  climb  1000  fpm,"  or  a 
positive  command,  e.g.,  "Climb,"  or  "Turn  right."  The  maneuver  selection 
logic  is  designed  to  provide  separation  between  two  aircraft,  even  if  only 
one  is  equipped  and  follows  the  commands.  When  ground  radar  timing  signals 
are  not  available,  the  ASA  system  sends  out  a  signal  that  causes  the  trans¬ 
ponder  of  near  by  aircraft  to  send  a  reply.  The  system  measures  the  round 
trip  travel  time  of  the  signal  to  find  the  distance  to  the  other  aircraft. 

The  closure  rates  are  computed  in  the  same  manner  as  explained  above  and 
appropriate  vertical  command  are  generated  to  provide  separation  between 
aircraft. 


Scenarios 

Each  flight  crew  that  participates  in  this  experiment  will  fly  three 
flights  within  a  two-hour  block.  The  three  flights  will  be  selected  from 
six  flight  scenarios,  all  starting  from  Los  Angeles  International  Airport 
(LAX)  and  involving  a  departure,  short  enroute  segment  during  which  the 
flight  will  change  course  so  as  to  make  an  approach,  and  landing  back  at  LAX. 
A  series  of  traffic  conflicts  will  be  created  during  the  flight  to  exercise 
the  ASA  system. 

The  six  flight  scenarios,  with  nominal  flight  paths,  are  shown  in 
Figures  14  through  19.  The  departures  are  consistent  with  flights  to 
Las  Vegas,  San  Diego,  Santa  Barbara,  or  Bakersfield.  Arrivals  back  at  LAX 
are  similar  to  arrivals  from  these  same  cities. 

Simulation  Sessions 

The  simulation  sessions  will  normally  be  conducted  after  8  p.m.  MST. 

A  crew  briefing  will  be  conducted  before  each  simulation  session,  where  the 
crew  will  be  assigned  the  specific  flights,  the  operation  of  the  display  will 
be  reviewed,  and  procedural  questions  will  be  answered. 

Procedures 

During  the  pre-simulation  briefing  session  you  will  meet  the  other 
member  of  the  test  crew.  He  may  or  may  not  represent  the  same  company  as 
you,  so  it  will  be  appropriate  for  you  to  discuss  crew  coordination.  You 
should  decide  who  will  act  as  captain  Zox  the  session.  It  is  important 
that  each  subject  participate  by  flying  the  simulator,  therefore,  you  should 
reach  an  agreement  on  how  you  wish  to  divide  the  flying  time. 

During  the  simulation,  an  observer  will  be  present  in  the  cockpit  to 
observe  crew  actions.  In  addition,  an  audio  recording  will  be  made  to  use 
in  analysis  of  the  crew's  actions. 

During  the  simulation,  you  should  plan  to  follow  all  FAA  rules  and 
regulations  as  pertains  to  adherence  to  clearances,  etc.  In  the  event 
an  ASA  conflict  causes  you  to  deviate  from  your  clearance,  you  should 
take  the  same  actions  that  you  now  take  when  you  make  an  emergency  deviation. 

After  the  simulation  period,  the  crew  will  be  asked  to  complete  a 
questionnaire  and  comment  sheet.  In  addition,  a  debriefing  will  be  conducted 
to  further  explore  crew  member  reactions. 
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Figure  17.  APPROXIMATE  FLIGHT  PATH,  SCENARIO 


APPENDIX  C 


SUBJECT  PILOT  PRE-BRIEFING 


This  appendix  addresses  the  material  and  information  associated  with 
the  pre-brief ing  given  to  each  subject  crew  before  the  simulation  session. 

The  pre-brief ing  consisted  of  a  slide  show  and  video  tape  recording,  a  dis¬ 
cussion  of  pilot  procedures  regarding  conflict  escape  maneuvers,  a  descrip¬ 
tion  of  the  specific  scenarios  that  the  crew  would  be  flying,  and  an 
orientation  session  in  the  cockpit  simulator. 

The  slide  show  amplified  and  clarified  the  information  sent  to  the 
pilots  in  the  advanced  briefing  (Appendix  B) .  It  also  incorporated  all  of 
the  changes  made  to  the  program  since  the  advanced  briefing  was  mailed. 

These  slides  are  presented  at  the  end  of  this  appendix. 

Additional  slides  and  a  video  tape  recording  were  used  to  further 
explain  the  displays  used  in  the  simulation.  A  separate  slide  was  shown 
for  each  of  the  possible  commands  that  could  be  displayed  on  the  IVSI  and 
LED  displays.  Due  to  the  greater  complexity  of  the  CRT  display,  a  video 
tape  of  a  developing  conflict  was  presented  to  the  test  subjects  for  fur¬ 
ther  explanation. 

The  escape  maneuver  discussion  established  the  following  procedures: 

•  CLIMB  COMMAND  Rotate  to  a  pitch-up  attitude  approximating 

a  go-around  configuration.  Apply  thrust  as 

required. 

•  DESCENT  COMMAND  Reduce  thrust.  Pitch  over  at  an  attitude 

approximating  a  profile  descent. 

•  TURN  COMMAND  Roll  into  a  30°  bank  in  the  direction 

of  the  command. 

•  LIMIT  VERTICAL  COMMAND  Obey  the  limit  instruction. 

•  MO  TURN  COMMAND  Cease  or  avoid  turning  in  the  direction 

of  the  command. 
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INITIATE  AN  ESCAPE  MANEUVER  IF . 

1.  A  conflict  is  perceived  in  the  cockpit  visual  system. 

2.  A  conflict  is  perceived  based  on  display  traffic  advisory 
information. 

3.  A  command  is  presented  on  one  of  the  ASA  displays. 

TERMINATE  AN  ESCAPE  MANEUVER  IF . 

1.  The  displayed  command  is  cleared. 

2.  The  conflict  no  longer  exists  and  the  display  is  clear. 

Negative  and  limit  vertical  commands  may  occur  even  if  the  aircraft  is 
straight  and  level  or  maneuvering  in  the  opposite  direction.  These  commands 
are  advisory  in  nature.  Positive  commands  should  always  be  followed. 

After  the  pre-brief ing ,  the  pilots  were  given  a  packet  of  information, 
which  included  the  appropriate  charts,  for  navigation  in  the  Los  Angeles 
area  (Low  Altitude  En  Route  Charts,  Area  Charts,  Standard  Terminal  Arrival 
Route  (STAR)  Charts,  Standard  Instrument  Departure  (SID)  Charts,  etc).  The 
three  scenarios  to  be  flown  were  illustrated  on  the  Area  Charts.  The  pilots 
were  informed  of  the  order  that  the  scenarios  would  be  flown,  the  display 
that  would  be  active  during  the  scenario,  and  the  proposed  flight  plan. 

They  were  not  given  information  on  the  conflict  geometries  or  locations. 

The  pre-briefing  was  concluded  in  the  cockpit  simulator.  Pilots  that 
were  unfamiliar  with  the  United  Airlines  727  simulator  were  briefed  on  its 
operation  and  the  associated  visuals.  In  addition,  before  each  scenario, 
the  appropriate  display  was  exercised  to  review  the  display  presentation 
and  interpretation. 


COCKPIT 

DISPLAY 

EVALUATION 


BRIEFING  OUTLINE 


•  Objectives 

e  CAS/ ASA  Background 

•  ASA  System  -  Combination  of  Techniques/Modes 

••  BCAS 

•••  Active  Mode 
•••  Full  BCAS  Mode 
••  DABS 

•  ASA  System  Logic 

•  ASA  Commands 
e  SOP  Flying  ASA 

(continued) 


BRIEFING  OUTLINE  (continual) 


•  Displays 

••  Modified  IVSI 
••  LED 
••  CRT 

•  Test  Equipment  Setup 

••  B727  Simulator  with  CGI 

••  Test  Computer 
••  ATC  Controller 
••  Test  Computer  Operator 
••  Cockpit  Observer 
••  Data  Recording 

•  Scenario  Review  and  Display  Assignment 

•  Test  Session 

•  Debriefing 


OBJECTIVES 

•  Evaluate  Display  Concepts 

••  Determine  information  required  by  flight  crew 
••  Most  effective  way  to  display  it 

•  Evaluate  Operational  Impact  on  Flight  Crew  of  Utilizing 
Proposed  Displays 
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BASIC  PRINCIPLES 

•  ATC  Controller  Responsible  for  IFR  Separation 

•  Pilot  Responsible  for  Sefety  of  His  Flight 

•  Collision  Avoidance  System  is  a  Backup  to 
Basic  ATC  System 
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BACKGROUND 

•  Industry  Collision  Avoidance  System 
Program  Sinca  1950s 

••  Compatible  equipment  in  aircraft 
••  Based  on  tracking  ATC  transponder  signals 
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ASA:  COMBINATION  OF  TfCHNIQUES/MOOIB 
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BEACON  COLLISION  AVOIDANCE  SYSTEM 
(BCAS) 


Traraponder  Siftali 
•nd 

Altitudt  Reporting 


V _ _ J 


ASA  MODES 


•  Active 

aa  No  bearing 
••  Vertical  maneuver*  only 

•  Full 

••  Bearing 

••  Vertical  or  horizontal  maneuver* 


ACTIVE  BCAS  MODE 


Actively  Interrogate*  Other  Aircraft  in  Same  Way 
a*  Ground  Radar 

•  Advantage 

••  Can  operate  without  ground  radar 
•a  Will  provide  protection  in  majority  of  area* 

•  Problem 

a#  Cause*  radar  interference  -  limited  to  low* 
traffic-density  airspace 
aa  Cannot  determine  bearing  to  intruder 


FULL  BCAS  MODE 

•  Can  Datarmina  Bearing  of  Intrudar 

•  Requires  Ground  Radar  Signals 


DISCRETE  ADDRESS  BEACON  SYSTEM 
(DABS) 


Conflict  Alert 
and 

Resolution 
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DABS 


ASA  SYSTEM  LOGIC 


r 


a 


•  Tracks  Aircraft  within  Specified  Distance 

•  Determines  Range  and  Closure  Rate 

•  Selects  Command 

•  Provides  Separation  Even  If  Only  One  Aircraft 
Follows  Command 


ASA  COMMANDS 


e  Limited  Vertical 

••  Limits  climb/descent  to  2000,  1000,  500  fpm 
e  Negative  Commands 

•e  Don't  Climb 
••  Don't  Descend 
ee  Don't  Turn  Right 
ee  Don't  Turn  Left 

e  Positive  Commands 

ee  Climb 
ee  Descend 
ee  Turn  Left 
ee  Turn  Right 


I  Him 


SOP  (ALL  DISPLAYS) 

•  Start  the  Maneuver  When  You  Believe  It  Necessary 

•  Advise  ATC  if  Devietion  from  Flight  Path 

•  Acquire  Target  Visually  if  Possible 


V. 


DISPLAYS 

•  Modified  IVSI 

•  LED 

•  CRT 
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MODIFIED  IVSI  DISPLAY 


•  Display  Characteristics 

••  Standard  IVSI  and  command  indicators 
••  Replaces  IVSI  for  captain  and  first  officer 

•  Symbology 
••  Arrows 

••  "Don't  Turn"  lights 
••  "Limit  Climb"  commands 


MODIFIED  IVSI  DISPLAY  (continued) 

•  How  to  Fly  IVSI  Display 

••  Follow  red  arrows  and  "Don't  Turn"  lights 
••  Don't  climb/descend  into  lighted  yellow  arc 

•  Modes 

••  Full  Mode:  Climb/Descend/Turn  commands 
••  Active  Mode:  No-Tum  commands 


LED  DISPLAY 


•  Display  Characteristics 
••  3  lines  of  information 

•••  Traffic 
•••  Commands 
••  Colors 

•••  Green:  Traffic  advisory 
•••  Orange:  Limited  vertical 
•••  Red:  Positive  Command 


CRT  DISPLAY 


Display  Characteristics 

••  Located  where  weather  radar  is  normally  mounted 

••  Traffic  filtered  by  logic  so  that  only  traffic  of 
concern  is  displayed 

•••  Range 
•••  Closure  Rate 
•••  Range/Range  Rate 
•••  Altitude 


(continued) 


CRT  DISPLAY  (continued) 


•  Symbology:  Full  Mode 

••  Ownship  and  altitude 
••  Range  marks:  3,  6,  9  miles 
••  Traffic  symbol 
••  Intruder  symbol 

•  Symbology:  Active  Mode 

••  Range 

••  Altitude 

••  Command  (vertical  only) 
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•  B727  Simulator  with  CGI  Visual 

ee  2-window  visual 

ee  LAX  city  lights  and  navigational  aids 

ee  Intruder  aircraft  -  rod  flashing  beacon;  white 
steady  taillight 

ee  3  displays  (IVSI,  LED,  CRT) 
e  Test  Computer 

ee  Tracks  simulator 
ee  Establishes  conflicts 
ee  Provides  ATC  controller  display 
••  Records  data 


(continued) 


C-13 


TEST  EQUIPMENT  SETUP  (continued) 

•  ATC  Controller 

••  Provides  ATC  instructions 

•••  Not  call  treffic  due  to  simuleted  high  workload 
eee  Allow  conflicts  to  develop 

•  Test  Computer  Operator 

ee  Arranges  intruder  aircraft  tracks 
••  Data  recording 

(continued) 


TEST  EQUIPMENT  SETUP  (continued) 

e  Cockpit  Observer 

•• 

Notes  crew  reection: 

eee  Did  you  see  intruder  aircraft? 
eee  Was  command  maneuver  satisfactory? 

•• 

Coordinates  with  test  computer  OPR 

•• 

Answers  crew  questions 

•• 

Briefs  and  debriefs  crews 

•  Recording  Data 

•• 

Automatically  by  computer 

•• 

Crew  reaction  and  irregularities  manually  by 
cockpit  observer 

•• 

Tape  recording  of  cockpit  conversations 

_ J 
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APPENDIX  D 


FLIGHT  CREW  QUESTIONNAIRE 


Immediately  following  each  simulator  session,  each  member  of  the  flight 
crew  was  asked  to  complete  a  questionnaire  which  addressed  the  following 
areas : 

•  Pilot  Background 

•  Quality  of  Displayed  Commands 

•  Display  Characteristics 

•  Display  Usability 

•  Traffic  Advisories 

•  Command  Presentation 

•  ASA  Concepts 

•  Display  Evaluation 

•  ASA  Program 

This  appendix  reproduces  the  questions  and  tabulated  responses  from 
the  flight  crew  questionnaires.  The  results  are  presented  as  a  percentage 
of  all  pilots  that  responded  to  the  question  followed  by  the  number  that 
responded  (in  parentheses) .  Following  the  results  are  the  comments  offered 
by  the  participants.  The  comments  are  included  with  only  minor  editorial 
changes  to  improve  readability .  Preceding  each  comment  is  a  number  that 
was  assigned  to  each  pilot  and  the  responses  made  by  that  pilot. 

An  abbreviated  version  of  the  questionnaire  was  given  to  the  first 
three  crews  (10  pilots) .  Additional  questions  were  added  following  dis¬ 
cussions  with  the  FAA  and  are  noted. 

The  pilot  background  data  are  summarized  in  Section  3.3  and  not 
repeated  here;  however,  the  questions  are  included  for  completeness. 
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AIRCRAFT  SEPARATION  ASSURANCE 
COCKPIT  EVALUATION 
FLIGHT  CREW  QUESTIONNAIRE 

Name :  _ 

Company :  _ 

Present  Position :  _ 

Pilot  Certificate  (s)  Held:  _ 

Ttotal  Hours :  _ 

Other  Aircraft  Regularly  Flown: 

Were  you  familiar  with  the  ASA  program  prior  to  your  solicitation  or 
selection  to  participate  in  this  experiment? 

YES  11%  (8)  NO  55%  (41)  VAGUELY  34%  (25) 

Do  you  regularly  fly  into  LAX? 

YES  54%  (40)  NO  46%  (34) 

(Approximately  _  times  a  year) 


Aircraft : 


Past  Year: 


SECTION  I 


This  section  examines  the  quality  of  the  displayed  commands.  Please 
answer  each  question  for  each  display.  If  you  wish  to  qualify  any  answer, 
please  comment  in  the  blank  space  below  the  question. 


1.  In  general,  were  the  actions  required  by  the  commands  clear  and 
unambiguous? 


ALWAYS 

USUALLY 

SELDOM 

NEVER 

IVSI : 

56%  (41) 

38%  (28) 

6%  (4) 

0 

LED: 

57%  (42) 

36%  (27) 

7%  (5) 

0 

CRT: 

59%  (43) 

37%  (27) 

4%  (3) 

0 

PILOT  # 

RESPONSES 

COMMENTS 

(6) 

TVSI: 

Usually 

At  one  point  on  IVSI ,  a  descent  command 

LED: 

Always 

was  given  followed  by  a  max  climb  of 

CRT: 

Always 

500  FPM  followed  by  a  descent  -  during 
that  period,  a  continuous  descent  of  over 
1000  FPM  or  more  was  maintained. 

(9) 

IVSI: 

Usually 

IVSI  takes  getting  used  to.  One  time  you 

LED: 

Always 

go  to  the  light,  the  other  you  go  away 

CRT: 

Always 

from  the  light. 

(39) 

IVSI: 

Always 

CRT  -  Hard  to  read  -  display  too  small  in 

LED: 

Always 

readout.  LED  -  Should  be  relocated  for 

CRT: 

Usually 

better  vision. 

(40) 

TVSI: 

Always 

CRT  -  Display  too  small.  Difficult  to 

LED: 

CRT: 

Always 

Seldom 

read  quickly. 

(41) 

IVSI: 

Usually 

IVSI  -  Don't  turn  not  prominent. 

LED: 

Always 

CRT  -  On  this  test,  was  very  wavy  and 

CRT: 

(No  answer) 

probably  would  have  been  easier  to  give 
a  better  rating. 

(43) 

IVSI: 

Usually 

Misread  limited  vertical  speed  indication 

LED: 

Always 

at  first.  (Interpreted  it  as  a  command 

CRT: 

Always 

to  climb  at  FPM) . 
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PILOT  # 

RESPONSES 

COMMENTS 

(59) 

IVSI: 

Always 

Commands  on  IVSI  and  LED  had  red  to 

LED: 

Always 

attract  attention  and  arrows  to  assist 

CRT: 

Usually 

rapid  interpretation. 

(67) 

IVSI: 

Always 

Poor  readout  on  LED. 

LED: 

Seldom 

CRT: 

Always 

Were 

able 

the  vertical  commands,  "CLIMB", 
when  presented  on  the : 

and  "DESCEND" 

clearly  understand- 

ALWAYS 

USUALLY 

SELDOM 

NEVER 

IVSI: 

82%  (60) 

18%  (13) 

0 

0 

LED: 

77%  (57) 

20%  (15) 

3%  (2) 

0 

CRT: 

78%  (58) 

20%  (15) 

2%  (1) 

0 

PILOT  # 

RESPONSES 

COMMENTS 

(39) 

IVSI: 

Always 

LED  -  Too  dim  to  read 

sometimes;  maybe 

LED: 

Usually 

due  to  location  on  the 

F/O's  side.  CRT 

CRT: 

Usually 

Little  hard  to  read  - 

readings  flicker. 

(66) 

IVSI: 

Usually 

Need  bigger  arrows  on 

IVSI. 

LED: 

Always 

CRT: 

Always 

(67) 

IVSI: 

Always 

poor  readout  on  LED. 

LED: 

Seldom 

CRT: 

Always 

Were  the  horizontal 
understandable  when 

commands  "TURN  LEFT" 
presented  on  the : 

and  "TURN  RIGHT" 

clearly 

ALWAYS 

USUALLY 

SELDOM 

NEVER 

IVSI 

:  80%  (58) 

19%  (14) 

1%  (1) 

0 

LED: 

85%  (63) 

12%  (9) 

3%  (2) 

0 

CRT: 

72%  (53) 

24%  (18) 

3%  (2) 

1%  (1) 
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3.  Continued 


PILOT  # 

RESPONSES 

COMMENTS 

(44) 

IVSI : 

Always 

Still  feel  the  LED  should  read  TURN  RIGHT 

LED: 

Always 

CRT: 

Always 

(60) 

IVSI: 

Always 

Not  presented  (Left  only,  I  believe). 

LED: 

Always 

CRT: 

Always 

(61) 

IVSI: 

Always 

Speed  brake  lever  blocks  lower  left 

LED: 

Always 

portion  of  scope. 

CRT: 

Always 

(66) 

IVSI : 

Usually 

Need  bigger  arrows  on  IVSI. 

LED: 

Always 

CRT: 

Always 

(67) 

IVSI: 

Always 

Poor  readout  on  LED. 

LED: 

Seldom 

CRT: 

Always 
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4. 


Were  the  limited  vertical  commands  (e.g., 
and  understandable  on  the : 


MAX  CLIMB  2000")  readable 


ALWAYS 

USUALLY 

SELDOM 

NEVER 

IVSI: 

56%  (39) 

39%  (27) 

5%  (4) 

0 

LED: 

72%  (52) 

21%  (15) 

7%  (5) 

0 

CRT: 

67%  (48) 

31%  (22) 

2%  (2) 

0 

PILOT  # 


RESPONSES 


COMMENTS 


(6) 


IVSI :  (No  answer) 

LED :  'Always 

CRT:  Seldom 


(ID 

IVSI: 

Usually 

LED: 

Always 

CRT: 

Usually 

(19) 

IVSI: 

Usually 

LED: 

Always 

CRT: 

Always 

(39) 

IVSI: 

Usually 

LED: 

Always 

CRT: 

Usually 

IVSI  -  From  copilot  seat,  max  climb  500, 
1000,  2000  FPM  light  bar  can’t  be  seen 
with  seat  in  normal  height  position.  Hard 
to  see  from  observer  seat.  CRT  -  From 
pilot  seat,  the  left  side  instruction 
(i.e.,  LMT  or  DON’T)  is  partially  or  com¬ 
pletely  blotted  out  by  the  speed  brake 
lever  handle.  Also,  positive  commands 
are  blocked  out  by  reverse  lever  knobs 
when  throttles  are  in  high  power  position. 

Would  command,  max  descent  500-1000-2000, 
require  any  descent? 


Climb  barely  visible. 


IVSI  -  F/0  side  with  seat  up;  Could  not 
see  it  until  looked  at  Capt’s  side. 
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PILOT  # 


RESPONSES 


COMMENTS 


(40) 

IVSI: 

Always 

LED: 

Always 

CRT: 

(No  answer 

(41) 

IVSI: 

Usually 

LED: 

Always 

CRT: 

Usually 

(44) 

IVSI: 

Always 

LED: 

Always 

CRT: 

Always 

(49) 

IVSI: 

(No  answer 

LED: 

Always 

CRT: 

Always 

(60) 

IVSI: 

Always 

LED: 

Seldom 

CRT: 

Always 

(61) 

IVSI: 

Usually 

LED: 

Always 

CRT: 

Always 

(66) 

IVSI: 

Usually 

LED: 

Always 

CRT: 

Always 

(67) 

IVSI: 

Always 

LED: 

Seldom 

CRT: 

Always 

(71) 

IVSI: 

Usually 

LED: 

Always 

CRT: 

Always 

i 


When  I  was  flying  simulator,  CRT  display 
too  small  and  in  awkward  place.  Of  little 
value  to  person  flying  unless  other  pilot 
constantly  watches  CRT  and  keeps  pilot 
flying  informed. 

IVSI  -  climb  limit  is  recessed  too  deep 
with  the  instrument  in  its  present  position. 


If  LED  or  CRT  winds  up  as  final  configu¬ 
ration,  the  use  of  limited  vert  command 
on  IVSI  would  still  be  useful. 

LMT  climb  on  F/0  panel  not  completely 
visible . 


Light  too  dim  -  instrument  in  poor  position. 


At  normal  seat  position,  the  climb  unit 
lights  cannot  be  seen  directly. 


Yellow  arcs  on  IVSI  somewhat  hard  to  see 
when  you  sit  as  far  forward  and  up  as  high 
as  I  do  (I'm  short). 

Poor  readout  on  LED. 


Top  half  lights  hard  to  see;  top  of  case 
blocked. 
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5. 


Are  the  no  left  and  no  right  turn  commands  readable  on  the: 


ALWAYS 

USUALLY 

SELDOM 

NEVER 

IVSI : 

38%  (27) 

45%  (32) 

11%  (8) 

6%  (4) 

LED: 

81%  (58) 

19%  (14) 

0 

0 

CRT: 

75%  (55) 

21%  (15) 

4%  (3) 

0 

PILOT  # 

RESPONSES 

COMMENTS 

(6) 

IVSI: 

Usually 

No  right  turn  can't  be  seen  from  observer 

LED: 

Always 

seat. 

CRT: 

Seldom 

The  word  "DON'T"  is  blocked  by  speed 

(39) 

IVSI: 

Always 

IVSI  could  be  changed  to  green  instead  of 

LED: 

Always 

a  red  light  display. 

CRT: 

Always 

•* 

(54) 

IVSI: 

Usually 

After  learning  what  they  meant  on  the  IVSI 

LED: 

Always 

it  was  no  problem. 

CRT: 

Always 

(58) 

IVSI: 

Seldom 

Hard  to  see  and  include  in  cross  check. 

LED: 

Usually 

CRT: 

Usually 

(60) 

IVSI: 

Never 

Did  not  have  command. 

LED: 

Always 

CRT: 

Always 

(61) 

IVSI: 

Seldom 

IVSI  was  very  dim  and  was  seen  only  in 

LED: 

Usually 

initial  test  run. 

CRT: 

Always 

(63) 

IVSI: 

Never 

Did  not  see. 

LED: 

Always 

CRT: 

Always 

(74) 

IVSI: 

(No  answer) 

Hard  to  see  on  F/0  side. 

LED: 

Always 

CRT: 

Always 
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6.  a) 

PILOT  # 

What  changes  in  format  should  be  made  to  improve  the: 

IVSI : 

LED: 

CRT: 

COMMENTS 

(1) 

LED: 

CRT: 

Instrument  placement 

Instrument  placement,  color  commands 

1  (2) 

IVSI: 

CRT: 

No  turn  lights -larger 

Range  circles  lighted  for  night  use 

(3) 

IVSI: 

LED: 

Position  instrument  where  more  visible 

Reposition  to  where  all  crew  members  can  see 

(4) 

IVSI: 

LED: 

CRT: 

Improve  "No  Left"  and  "No  Right"  readability;  also, 
limit  climb  lights  are  hard  to  see. 

Hard  to  interpret  intruder's  heading  compared  to  our  own. 
Difficult  to  relate  intruder's  position  to  our  own  -  not 
easy  to  decipher  degree  of  threat  quickly. 

Move  data  tag  away  from  intruder  tail  so  that  speed  and 
direction  are  easier  to  see. 

(5) 

t 

LED:. 

When  an  action  is  required,  delete  the  traffic  advisory 
message.  The  "LED"  display,  if  used,  should  be  mounted 
to  allow  S/0  to  observe  display  (one  display  visible  to 
all) . 

1  !  (6) 

: 

1 

IVSI: 

Signals  more  prominent,  plus  additional  information,  i.e., 
LED  altitude  and  distance  information. 

! 

f 

CRT: 

Altitude  indications  not  big  enough,  commands  hard  to  see. 

(7) 

IVSI: 

CRT: 

Larger  letters 

Targets  too  small 

(9) 

CRT: 

Too  bright  in  active  mode;  to  get  full  benefit  of  the 
system,  we  should  be  able  to  call  up  all  targets  on  the 

CRT  if  we  choose.  That  way,  we  can  provide  separation 
on  targets  that  may  not  be  a  threat. 

(10) 

IVSI: 

LED: 

More  positive  expression  of  "Don’t  Turn  Left/Right" 

Format  O.K. ,  position  distracts  scan 

i 

CRT: 

Format  O.K.,  takes  some  time  to  evaluate  (no  basic  problem) 

)  (id 

LED: 

CRT: 

Little  out  of  scan 

Very  hard  to  read  numbers;  location  a  problem;  has  tendency 

to  lock  viewer  to  screen. 


Question  #6a  continued 


PILOT  # 

COMMENTS 

(12) 

CRT: 

Better  range  marks 

(13) 

LED: 

Lights  need  to  be  brighter 

(14) 

LED: 

More  differentiation  between  clock  position  and  range. 

(15) 

IVSI : 

Location 

LED: 

Location 

CRT: 

Two  -  on  forward  panel 

(21) 

IVSI: 

Larger  negative  command  displays 

CRT: 

Better  and  larger  symbols;  seme  confusion  apparent  in  logic 

(22) 

LED: 

The  readout  of  information  is  too  small;  instrument  located 
in  bad  position  on  instrument  panel. 

(24) 

IVSI: 

More  visible  limit  vertical  speed 

LED: 

Location  of  LED 

(25) 

IVSI: 

Turn  Left,  Turn  Right  symbology  with  i.:rows;  no  alpha 

LED: 

F/O  brighter  display  needed 

(26) 

LED: 

Relocate  LED  on  Capt's  side 

(30) 

IVSI: 

Would  like  to  have  this  information  on  the  approach  horizon 

LED: 

Physical  location  bad  -  F/E  out  of  the  loop 

CRT: 

Visibility  in  daylight  may  be  a  problem 

(31) 

IVSI: 

No  Left  and  No  Right  commands  could  be  displayed  larger 

LED: 

Position  instrument  at  higher  eye  position 

(32) 

IVSI: 

Arrows,  left-right  should  be  out  of  instrument 

IVSI  is  a  "vertical  speed"  device.  A  fatigued  pilot  may 
not  associate  left-right  with  IVSI. 

(33) 

IVSI: 

Larger-brighter 

LED: 

Same 

CRT: 

Need  more  clarity 

(34) 

CRT: 

Aircraft  information  too  small  -  couldn't  read 

(35) 

IVSI: 

O.K. 

LED : 

Very  poor  display;  cannot  recommend  a  fix 

CRT: 

Larger  printing  for  altitude 

Vaa  »V 
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Question  #6a  continued 


PILOT  #  COMMENTS 


(36) 

IVSI : 

Larger  display  on  NO  TURN 

CRT: 

Did  not  like  active  mode  format.  (No  need  for  the  format 
as  you  would  learn  symbols) .  Symbols  too  small. 

(37) 

IVSI: 

No  change 

LED: 

No  change 

CRT: 

Did  not  like  active  format 

(38) 

IVSI: 

None 

LED: 

None 

CRT: 

Not  clear  enough  for  the  pilot  flying  without  taxing 
concentration.  Perhaps  larger  target  display. 

(39) 

TVS  I: 

Relocate  or  tilt  to  see  climb  portion 

LED: 

Relocate  higher  up 

CRT: 

Larger  readout  on  aircraft  display 

(40) 

CRT: 

Display  must  be  much  larger,  and  this  unit  also  requires 
thinking  time  more  so  than  others  (IVSI  and  LED)  in 
determining  how  close  the  traffic  was. 

(41) 

IVSI: 

Change  location  or  bring  face  closer  to  glass 

(42) 

IVSI: 

"No  turn  commands"  larger 

LED: 

None 

CRT: 

None 

(44) 

IVSI: 

O.K. 

LED: 

Add  turn  direction  i.e.,  TURN  RIGHT 

(45) 

IVSI: 

No  turn  lights  too  small 

(46) 

CRT: 

Difficult  to  read  from  Capt.  seat.  Speed  brake  handle 
and  throttles  in  way. 

(48) 

IVSI: 

No  left/no  right  turn  lights  too  small 

LED: 

Eliminate  direction  of  flight  information 

(49) 

IVSI : 

Location  -  "Don't  turn"  ambiguous 

LED: 

Location 

(50) 

IVSI: 

Make  no  left  and  no  right  brighter.  At  level  flight, 
left  turn  arrow  obscured  by  IVSI  needle. 

LED: 

Less  text  and  more  symbolic  displays 
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(53) 

IVSI : 

LED: 

(54) 

IVSI: 

LED: 

CRT: 

(55) 

IVSI : 

(57) 

IVSI: 

LED: 

CRT: 

(58) 

IVSI: 

LED: 

CRT: 

(59) 

IVSI: 

LED: 

CRT: 

(60) 

IVSI: 

(61) 

IVSI: 

LED: 

(62) 

CRT: 

(63) 

IVSI : 

LED: 

CRT: 

(65) 

IVSI: 

CRT: 

(66) 

CRT: 

(67) 

LED: 

CRT: 

(68) 

CRT: 

Brighter  display 
Brighter  display 

Not  worth  improving 

Can't  really  say  after  such  short  exposure  to  both  these 
systems . 

Same 

Better  no  left/right  -  hard  to  see 

Good 

Good 

More  distinctive  command  display 

Better  (larger)  no  turn  indicators 
Place  closer  to  normal  scan  pattern 

It  was  outside  my  normal  scan  pattern;  Consequently,  I 
did  not  cross  check  frequently. 

None  within  constraints  of  instrument 
None 

Red  commands  and  amber  for  maneuvers  limit.  Arrows  for  commands. 
Don't  like  negative  commands 

Perhaps  use  one  light  in  corner  (red)  to  signal  no  turn. 
Location  is  very  poor  as  is.  Doesn’t  draw  your  attention. 

More  distinctive  audio 

O.K. 

O.K. 

Larger  symbols  and  relocate 

Eliminate  instrument 
Use  color  coding  of  LED 

Use  arrows  instead  of  text  for  positive  commands 

Improve  readout  clarity 
Altitude  readout  too  small 

Symbology  of  altitude  readout 
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Question  #6a  continued 


PILOT  # 

COMMENTS 

(69) 

LED: 

CRT: 

Too  much  data  (i.e.,  second  target) 

Too  much  symbology 

(70) 

CRT: 

None  -  would  be  better  as  experience  is  gained  with 
CRT  presentation 

(71) 

IVSI: 

Top  lights  (limit  climb)  should  be  made  more 

visible 

(72) 

CRT: 

Too  much  writing  on  scope  in  active  mode 

(73) 

CRT: 

Active  mode  could  use  less  words  in  constant 

display 

(74) 

CRT: 

Active  mode  writing  should  be  left  off 

6.  b)  In  your  opinion,  what  is  the  best  presentation  for  positive 
commands  (e.g.,  text,  arrows)? 

(Added  as  part  of  questionnaire  revision) 


PILOT  tt 
(11) 

(12) 

(13) 

(14) 

(15) 

(16) 

(17) 

(18) 
(20) 
(21) 


COMMENTS 

Arrows  or  combination  of  both 
Arrows 

Arrows  -  there  is  no  doubt  which  way  to  turn  -  best  in 
my  opinion 

Text 

Arrows 

Text 

Arrows 

IVSI 

Arrows 

LED 
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Question  #6b  continued 


PILOT  # 


COMMENTS 


(22) 
(2  3) 

(24) 

(25) 

(26) 

(27) 

(28) 

(29) 

(30) 

(31) 

(32) 

(33) 

(34) 

(35) 

(36) 

(37) 

(38) 

(39) 

(40) 


Text 

Arrows 

Red  text 

Arrows 

LED 

CRT 

LED  -  better  to  see  arrows  than  to  read  it 
Text 

The  arrows  are  quite  effective.  They  stand  out,  but  the 
text  is  quite  satisfactory. 

Text 

LED  -  for  arrows?  trying  to  associate  position  of  aircraft 
with  target  was  a  bit  confusing. 


Arrows 

Arrows 

IVSI  -  a  simple  positive  presentation 
LED  -  was  best  -  plain  language 

rvsi 

Arrows 

Text  and  arrows  -  maybe  combination  of  arrows  on  CRT? 
descent  or  climb  -  left  turn  or  right  turn 

Either  the  LED  or  the  IVSI  arrows  were  acceptable.  Note: 
I'd  prefer  to  see  green  arrows  used  to  indicate  where  to 
go  instead  of  red. 


lestion  #6b  continued 


PILOT  # 


COMMENTS 


Arrows  and  text 


Likes  the  LED  presentation 


Text  and  arrows 


Combinations 


Arrows 


Arrows  best,  but  I  found  no  difficulty  interpreting  text  either 


Arrows 


Arrows  -  they  require  only  a  glance  for  full  recognition 


Combination  of  text  and  arrows 


Combination  of  a  picture  with  text  as  in  the  CRT 


CRT  display 


Arrows 


Arrows  -  or  arrows  and  text 


Arrows  (with  text  to  improve  interpretation) 


A  bright  display  that  will  immediately  catch  your  attention. 
Perhaps  similar  to  master  caution  on  B737. 


Arrows  -  they  are  simple  -  direct  -  positive 


J 


Question  #6b  continued 


PILOT  # 
(62) 

(63) 

(64) 

(65) 

(66) 

(67) 

(68) 

(69) 

(70) 

(71) 

(72) 

(73) 

(74) 


COMMENTS 
Text  and  arrows 

For  positive  command,  the  TVSI  is  best  but  doesn't  give 
any  information  to  the  pilot  for  him  to  decide  what  degree 
of  a  maneuver  to  use.  For  that  case  the  LED  serves  better. 

Text 

Text  and  arrows  combined 

Arrows  are  much  easier  to  react  quickly  to 

Arrows 

Text 

Text  (LED) 

LED  -  at  present 
Arrows 

Arrows  with  word  climb 
LED 

Arrows  first  -  then  text 
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SECTION  II 


This  section  examines  the  characteristics  of  the  displays. 

7.  Did  the  use  of  color  (green  for  advisories,  yellow  for  maneuver  limits 
and  red  for  commands)  help  in  interpreting  the  information  presented 
on  the : 

VERY  MUCH  SOME  VERY  LITTLE  NONE 

IVSI:  44%  (31)  39%  (28)  16%  (11)  1%  (1) 

LED:  55%  (40)  32%  (23)  11%  (8)  2%  (2) 


PILOT  # 

RESPONSE 

COMMENTS 

(42) 

IVSI :  Very  Little 
LED:  Very  Little 

They  would  help  after  more  familiarization 

(43) 

IVSI :  Very  Little 

LED:  Very  Much 

Red  got  my  attention  on  LED.  Couldn't 
care  less  about  color  on  IVSI. 

(49) 

(No  answer) 

I  did  not  think  of  the  color  code  but 
am  sure  that  subconsciously  it  did  have 
an  effect  on  the  action. 

(71) 

IVSI:  Very  Little 
LED:  Very  Little 

Might  depend  on  experience 

(74) 

IVSI :  Some 

LED:  Very  Much 

Hard  to  see  on  F/O 

8.  a) 

On  the  CRT,  were  you  able  to 
and  non-threat  targets  prior 

differentiate  between  threat  targets 
to  commands? 

YES  76%  (45) 

NO  24%  (14) 

(Added  as  part 

of  questionnaire  revision) 

PILOT  # 

RESPONSE 

COMMENTS 

(15) 

YES 

After  some  thought 

(25) 

NO 

Because  I  did  not  respond  to  display 

unless  alert  sounded. 
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Question  #8 a  continued 
PILOT  #  RESPONSE 

(39)  YES 


(58)  YES 

(62)  (No  answer) 


(63)  YES 

(64)  YES 


(70) 


NO 


COMMENTS 


If  in  level  flight;  in  a  turn,  have  to 
think  which  way  he's  going  in  relation 
to  your  aircraft. 

Somewhat,  however,  that  was  difficult 
because  of  CRT  placement. 

Time  consuming  to  analyze  initial  pre¬ 
sentation,  requires  head  down. 

But  very  time  consuming 

But  took  time  to  completely  understand 
information  presented  -  direction  of 
intruder  aircraft  track  would  be  more 
helpful  than  the  tail. 

Believe  with  experience  I  could 
differentiate  much  better. 


8.  b)  Would  the  use  of  colors  (green  for  advisories,  yellow  for  maneuver 
limits  and  red  for  commands)  help  you  in  interpreting  the  informa¬ 
tion  presented  on  the  CRT? 


VERY  MUCH 

SAME 

VERY  LITTLE 

NONE 

44%  (31) 

48%  (34) 

7%  (5) 

1%  (1) 

PILOT  # 

RESPONSE 

COMMENTS 

(4) 

Some 

If  filled  in  intruder  circle  turned 
it  would  enhance  warning  signal. 

(42)  Some  After  more  familiarization 
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9. 


a)  Was  the  range  information  used  for  this  test  satisfactory? 


VERY  MUCH  SOME  LITTLE  NONE 


LED: 

59%  (42)  32%  (23) 

9%  (6)  0 

CRT: 

59%  (43)  34%  (25) 

7%  (5)  0 

PILOT  # 

RESPONSES 

COMMENTS 

(14) 

LED: 

CRT: 

Some 

Some 

For  CRT,  would  rather  not  have  pop-up 
targets  at  short  range  if  possible. 

(24) 

LED: 

CRT: 

Very  Much 

Very  Much 

Larger  scale  with  more  warning  would 
allow  time  to  deviate  and  advise  ATC 

sooner. 

(60) 

LED: 

CRT: 

Very  Much 

Very  Much 

However,  in  CRT  test,  I  did  not  notice 
3  s  6  mile  radii  -  my  attention  was 
more  on  traffic  itself. 

(62) 

LED: 

CRT: 

Little 

Little 

Requires  head  down  and  time 

(74) 

LED: 

CRT: 

Some 

Very  Much 

Hard  to  interpret 

9. 

b) 

A  better 

scale  factor  would 

be : 

LED: 

CRT: 

PILOT  # 

COMMENTS 

(9) 

CRT  ; 

Selectable 

(10) 

LED  : 

If  the  display  came  on  infrequently,  one  could  forget 
the  positional  meaning  (heading,  range,  etc.) 

(12) 

CRT  : 
CRT  : 

Scale  needs  visibility  in^roved 

2  mile  scales  2-4-6-S 

(14) 

CRT  : 

At  short  range ,  increase  scale  so  that  full  scale  is , 
for  example,  4.5  versus  9  miles 
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Question  9b  continued 


PILOT  # 

COMMENTS 

(21) 

CRT  : 

One  or  two  mile  increments 

(24) 

LED  : 

Didn't  know  what  scale  was 

(37) 

LED  : 

No  change 

CRT  : 

Some  type  of  grid 

(41) 

CRT  : 

Might  be  better  if  unit  was  smaller  and  placed  on 
both  panels 

(43) 

CRT  : 

I  don't  feel  good  about  critiqueing  CRT.  of  the  three  I 
think  I  like  it  least.  Probably  need  more  time  with  CRT, 
but  still  probably  would  like  it  least  (except  in  active 
mode ) . 

(61) 

CRT: 

Range  lines  could  be  more  distinct 

(63) 

CRT: 

Lighted  range  scale  is  needed,  similar  to  a  radar. 

(65) 

More  experience  would  help  before  making  a  judgment 

(70) 

CRT-* 

Range  marks  on  CRT  which  I  understand  would  be  put  on. 
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SECTION  III 


This  section  examines  the  usability  of  the  displays. 


10.  Do  any  of  the  displays  contain  TOO  MUCH  or  TOO  LITTLE  information, 
that  is  —  is  the  display  too  busy  or  not  informative? 

(Added  as  part  of  questionnaire  revision) 


IVSI 

LED 

CRT 

About  right 

Add  the 
following 

Delete  the 
following 

PILOT  # 

RESPONSES 

(9) 

CRT: 

Add  the  following 

(12) 

LED: 

Delete  the  following 

CRT: 

Delete  the  following 

CRT: 

Delete  the  following 

(15) 

CRT: 

Add  the  following 

(20) 

CRT: 

Add  the  following 

COMMENTS 

Would  like  heading  readout  at  top 
and  eliminate  range  marks. 

This  presentation  is  busy  but  I 
don't  know  what  to  delete. 

Better  range  information  rate 
information  would  be  a  help. 

When  in  active  mode,  wording  on 
screen  distracted  from  information. 

Relative  bearing 

Color  and  better  range  information 
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Question  #10  continued 


PILOT  # 

RESPONSES 

COMMENTS 

(21) 

CRT: 

Add  the  following 

Projected  ground  track  of  intruder, 
color 

(23) 

LED: 

Delete  the  following 

Too  busy 

(24) 

CRT: 

Add  the  following 

Arrow  too  small  indicating  climb 
or  descent  of  opposing  traffic 

(25) 

LED: 

Delete  the  following 

Should  not  display  if  not  conflict¬ 
ing  with  aircraft 

(26) 

IVSI : 

Add  the  following 

Larger  no  turn  lettering 

CRT: 

Add  the  following 

Larger  letter  and  numbers  on  scope 

(27) 

LED: 

Add  the  following 

Confusing  at  first;  miles  and  altitude 

(28) 

IVSI: 

Add  the  following 

Would  help  to  have  distance  and 
bearing  to  intruder 

LED: 

Add  the  following 

Would  help  to  have  pictorial  display 
like  CRT 

CRT: 

Add  the  following 

Would  like  to  see  arrows  instead  of 
words  like  LED 

(29) 

IVSI: 

Add  the  following 

Could  use  range  and  bearing 

LED: 

Delete  the  following 

Could  be  confusing  with  3  lines 

CRT: 

About  right 

Has  potential  to  handle  information 

(33) 

IVSI: 

About  right 

LED: 

(No  answer) 

Simplify  readout 

CRT: 

(No  answer) 

Simplify  readout 

(34) 

LED: 

Delete  the  following 

Too  much  information;  information 
displayed  of  no  value,  not  relevant 

CRT: 

Delete  the  following 

Difficult  to  read  small  numbers,  too 
many  displays  not  relevant 

(35) 

IVSI: 

About  right 

LED: 

(No  answer) 

Did  not  care  for  other  display  - 

CRT: 

(No  answer) 

both  are  too  busy 
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COMMENTS 


Question  #10  continued 


PILOT  # 

RESPONSES 

COMMENTS 

(36) 

IVSI: 

Add  the  following 

Range  of  traffic;  bearing  of  traffic 

CRT: 

Add  the  following 

Symbols  too  small 

(37) 

IVSI: 

About  right 

LED: 

About  ricfrt 

CRT: 

Add  the  following 

Larger  letters  and  numbers 

(38) 

IVSI: 

About  right 

LED: 

About  right 

CRT: 

Add  the  following 

Targets  too  small 

(39) 

IVSI: 

Abouf  f  -jht 

LED : 

About  xi  *,t 

CRT: 

Add  the  following 

Arrows  for  descent,  climb,  left 
and  right  turns. 

(40) 

IVSI: 

About  right 

LED: 

About  right 

CRT: 

Delete  the  following 

The  characters  in  the  display  and 
eliminate  the  tendency  for  pilot 
to  evaluate  the  target  threat. 

(42) 

IVSI: 

Delete  the  following 

500  foot  limit  climb  or  descent 

LED: 

About  right 

CRT: 

About  right 

(44) 

IVSI: 

About  right 

LED: 

About  right 

Traffic  aircraft  track  information 
as  clock  relative  own  aircraft 

CRT: 

Add  the  following 

Indication  of  own  aircraft  rate  in 
horizontal  path  prediction 

(46) 

CRT: 

Delete  the  following 

"Active  wording" 

(48) 

IVSI: 

About  right 

LED: 

Delete  the  following 

Heading  and  possibly  altitude  of 
threat  of  aircraft 

CRT: 

About  right 

(49) 

IVSI: 

Add  the  following 

Let  turn  commands  correct  turns;  if 

in  left  turn,  would  be  sufficient 

to  stop  turn 

Don't  turn  commands 


IVSI :  Delete  the  following 
LED:  About  right 
CRT:  (No  answer) 


An  airplane  or  "H"  could  make  direction 
of  flight  easier  to  determine  in  place 
of  "0". 


Question  #10  continued 


PILOT  # 

RESPONSES 

(50) 

IVSI: 

About  right 

LED: 

Delete  the  following 

CRT: 

About  right 

(52) 

IVSI: 

About  right 

LED: 

Add  the  following 

(55) 

IVSI: 

About  right 

LED: 

About  right 

CRT: 

Add  the  following 

(58) 

IVSI: 

About  right 

LED: 

About  right 

CRT: 

Add  the  following 

(59) 

LED: 

About  right 

IVSI: 

Add  the  following 

CRT: 

About  right 

(60) 

IVSI: 

About  right 

LED: 

About  right 

CRT: 

Add  the  following 

(61) 

IVSI: 

Add  the  following 

LED: 

About  right 

CRT: 

Add  the  following 

COMMENTS 


Too  much  text;  replace  with  symbols 
For  display  of  target  positions. 
Text  could  be  replaced  with  symbols 
for  some  of  the  commands. 


Positive  commands  could  flash  on  and 
off  to  help  attract  attention  to 
essential  information.  Positive  com¬ 
mands  should  be  displayed  initially 
by  themselves  to  reduce  the  amount  of 
information  necessary  to  assimilate 
at  a  glance . 


Coloring 


I  found  the  small  aircraft  signs  hard 
to  see,  also  placed  outside  normal  scan. 

I  liked  the  advisories  of  LED  and  CRT 
but  could  not  add  within  constraints 
of  IVSI 


Calculation  of  max  rate  of  climb  - 
also  a  good  feature  of  the  LED 
Range ,  data  presentation 
Arrows  on  targets  should  be  bolder , 
perhaps  instead  of  solid  dot  to  re¬ 
present  conflict  -  a  blinking  dot 
could  be  used. 

Make  no  turn  signals  more  distinct 
Range  lines  could  be  clearer 
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Question  #10  continued 


PILOT# 

RESPONSES 

COMMENTS 

(62) 

IVSI : 

About  right 

LED: 

Add  the  following 

Simplify  advisory  information 

CRT: 

Add  the  following 

More  positive  target  direction; 
high  or  low  information;  descending 
or  climbing  information 

(63) 

IVSI : 

Add  the  following 

A  minimum  rate  of  maneuvering  should 
be  established.  Example:  2000  descent 
whenever  that  is  required. 

(65) 

LED: 

About  right 

CRT: 

Add  the  following 

Color  coding;  bigger  readout  of 
numerals 

(66) 

IVSI: 

Add  the  following 

Unfortunately,  this  display  provides 
no  information  on  where  threat  is  — 
this  is  useful  information. 

(67) 

IVSI: 

About  right 

LED: 

Add  the  following 

Altitude 

CRT: 

About  right 

(69) 

IVSI: 

About  right 

LED: 

Delete  the  following 

Too  much  data  when  2  targets  presented 

CRT: 

Delete  the  following 

(71) 

IVSI: 

About  right 

LED: 

Delete  the  following 

Could  delete  course  information 

CRT: 

About  right 

(72) 

IVSI: 

(No  answer) 

Couple  the  IVSI  command  display  with 
the  CRT  information  display  for  the 

best  combination. 

(73) 

LED: 

About  right 

Display  gets  busy  with  more  than 
one  target. 

CRT: 

Delete  the  following 

Fewer  words  to  indicate  "active  mode" 

(74) 

IVSI: 

Delete  the  following 

Maybe  only  have  2  minimum  and  maximum 
climbs  instead  of  3 

LED: 

Delete  the  following 

Too  much  traffic  information;  confusing 
to  read  and  quickly  interpret 

CRT: 

Delete  the  following 

No  active  paint  out  on  mode  on  top 
of  CRT 
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11.  bo  you  feel  that  the  audio  alert  was  necessary  to  draw  your  attention 


to  commands  on  the : 


ALWAYS  USUALLY 


IVSI : 

34% 

(24) 

18% 

(13) 

LED: 

38% 

(27) 

17% 

(12) 

CRT: 

40% 

(29) 

25% 

(18) 

PILOT  #  RESPONSES 


(4) 

IVSI 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(10) 

IVSI 

:  Never 

LED: 

Never 

CRT; 

Never 

(15) 

(No  . 

answer) 

(30) 

IVSI 

:  Never 

LED: 

Never 

CRT: 

Never 

(34) 

(No 

answer) 

(39) 

IVSI 

:  Usually 

LED: 

Usually 

CRT: 

Usually 

(42) 

IVSI 

:  Sometimes 

LED: 

Usually 

CRT: 

Usually 

'4*> 

IVSI 

:  Usually 

LED: 

Usually 

CRT: 

Always 

TVS  I:  Sometimes 
•  rr  :  Sometimes 

Sometimes 


ABOUT  HALF 


THF 

TIME 

SOMETIMES 

NEVER 

18% 

(13) 

23%  (16) 

7% 

(5) 

25% 

(18) 

15%  (11) 

5% 

(4) 

13% 

(9) 

15%  (11) 

7% 

(5) 

COMMENTS  ■< 

Easy  to  notice  visual  signal  at  night. 
Audio  alert  probably  much  needed  in 
daylight. 

Never  -  but  most  likely  because  we 
were  "primed"  for  this  alert  system. 

I  did  not  hear  it. 

At  night,  my  attention  was  drawn  to 
the  display.  In  fact,  at  one  time 
I  got  a  fixation  on  it  and  forgot 
the  horizon.  During  the  daylight,  the 
alert  might  be  more  important. 

Difficult  to  hear  any  of  the  audio 
alert  systems. 

If  not  on  radio  talking  or  listening, 
how  about  combination  audio  and  light. 

Depends  on  day  or  night. 


LED  needed  to  be  in  a  better  position. 


However,  I  don't  think  audio  is  loud 
or  strong  enough . 
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Question  #11  continued 


PILOT  # 

RESPONSES 

(55) 

IVSI : 

Always 

LED: 

Always 

CRT: 

Always 

(60) 

IVSI: 

Always 

LED: 

Always 

CRT: 

Always 

(62) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(63) 

IVSI: 

About  half 

the 

time 

LED: 

About  half 

the 

time 

CRT: 

Always 

(66) 

IVSI: 

Always 

LED: 

Always 

CRT: 

Always 

COMMENTS 

Should  be  a  more  distinctive  sound 
and  possibly  louder. 

Had  not  used  similar  equipment  before; 
also,  due  to  location  of  presentation. 

Need  more  distinctive  audio  signal 
standard  for  collision  avoidance. 


(only  because  of  location) 


I  don't  want  another  aural  sound, 
but  I  do  feel  it  was  necessary. 
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12.  a)  Does  the  modification  of  the  IVSI  by  addition  of  command  lights 
detract  from  the  primary  purpose  of  the  instrument? 

YES  7%  (5)  NO  93%  (66) 

RESPONSES  COMMENTS 

Yes  Probably  would  get  used  to  it. 

Yes  Maybe  a  single  light  at  500, 

1,000,  2,000. 

12.  b)  Could  another  existing  aircraft  instrument  be  modified  to  provide 
CAS  information? 

YES  _  NO  _ 

If  yes,  which  _ 

(Added  as  part  of  questionnaire  revision) 


PILOT  # 

RESPONSES 

COMMENTS 

(11) 

Yes 

Anything  in  scan  pattern  would  help. 

(15) 

Yes 

HSI 

(16) 

Yes 

Separate  instrument  at  top  of  panel. 

(21) 

Yes 

VSI  for  climb/ descent  and  HSI  for 
turns. 

(22) 

Yes 

(1)  the  radar  screen 

(2)  a  heads  up  display 

(23) 

Yes 

HSI 

(24) 

Yes 

HSI 

(29) 

Yes 

Cl  or  HSI 

(30) 

Yes 

The  approach  horizon 

(33) 

Yes 

Existing  radar  scope 
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PILOT  # 
(9) 

(39) 


Question 

#12b  continued 

PILOT  # 

RESPONSES 

COMMENTS 

(35) 

Yes 

RMI 

(36) 

Yes 

CRT  (HSI)  767 

(40) 

Yes 

Altimeter  —  but  might  be  much  more 
costly  and  clutter  up  the  instrument 
too  much. 

(42) 

Yes 

Weather  radar 

(44) 

Yes 

EHSI  in  767 

(50) 

Yes 

Possibly  FDI 

(51) 

Yes 

Flight  director 

(53) 

Yes 

Horizon 

(55) 

Yes 

Altimeter?  HSI 

(60) 

Yes 

Vertical  gyro  —  could  have  a  pitch 
command  bar  incorporate  the  IVSI 
information  —  same  with  the  bank 
steering  bar. 

(62) 

Yes 

Flight  director  command  signals 
should  be  interfaced  with  command 
bars  to  provide  both  manual  and 
automatic  action,  particularly 
during  auto  pilot  operation. 

(65) 

Yes 

HUD  -  whenever 

(66) 

No 

Not  what  we  currently  have 
available . 

13.  a)  VJhen  you  were  not  in  a  conflict  situation,  how  frequently  did  you 
include  the  display  in  your  cross-check? 


ABOUT  ONCE 
A  SECOND 


EVERY  TWO  TO 
FOUR  SECONDS 


ABOUT  EVERY 
FIVE  TO  TEN 
SECONDS 


LESS  THAN 
ONCE  IN 
TEN  SECONDS 


IVSI : 

11% 

(7) 

42%  (28) 

LED: 

3% 

(2) 

21%  (14) 

CRT: 

4% 

(3) 

17%  (12) 

PILOT  # 

RESPONSES 

(8) 

IVSI: 

About  once  a 

second 

LED: 

Less  than  once  in 

ten  seconds 

CRT: 

About  every 
ten  seconds 

five  to 

(9) 

IVSI: 

Every  two  to 
seconds 

four 

LED: 

Every  two  to 
seconds 

four 

CRT: 

Every  two  to 
seconds 

four 

(11) 

IVSI: 

Every  two  to 
seconds 

four 

LED: 

Every  two  to 
seconds 

four 

CRT: 

Every  two  to 
seconds 

four 

(13) 

(No  answer) 

(14) 

IVSI: 

Every  two  to 
seconds 

four  1 

LED: 

Every  two  to 
seconds 

four 

CRT: 

Every  two  to 
seconds 

four 

33%  (22) 
41%  (28) 
54%  (38) 


14%  (9) 
35%  (24) 
25%  (17) 


COMMENTS 


LED  needs  to  be  in  better  condition 


In  practice  though ,  it  would  probably 
be  less. 


Possibly  because  it's  new. 


Did  not  fly  the  instrument  long 
enough  to  work  into  the  cross-check. 
If  further  tests  are  conducted,  the 
same  crews  should  be  used  again. 

Obviously  a  function  of  the  test 
situation . 
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Question  #13a  continued 


PILOT  # 

RESPONSES 

(40) 

IVSI : 

About  every  five 
to  ten  seconds 

LED: 

About  every  five 
to  ten  seconds 

CRT: 

Every  two  to  four 
seconds 

(42) 

IVSI: 

Every  two  to  four 
se conds 

LED: 

E>very  two  to  four 
seconds 

CRT: 

Every  two  to  four 
seconds 

(49) 

(No  answer) 

(55) 

IVSI: 

Every  two  to  four 
seconds 

LED: 

Less  than  once  in 
ten  seconds 

CRT: 

About  every  five 
to  ten  seconds 

(59) 

IVSI: 

Every  two  to  four 
seconds 

LED: 

Less  than  once  in 
ten  seconds 

CRT: 

About  every  five 
to  ten  seconds 

(61) 

IVSI: 

Every  two  to  four 
seconds 

LED: 

Less  than  once  in 
ten  seconds 

CRT: 

About  every  five 
to  ten  seconds 

COMMENTS 


Found  myself  cross  checking  for 
commands  —  needless  effort. 


Probably  much  less  in  line  flying. 


It  is  hard  to  say.  Initially,  I 
was  waiting  for  it  to  go  off.  I 
think  after  some  time  using  the 
system  you  would  not  notice  it  as 
as  much.  (Audio  needed) 

LED  -  Could  have  been  bad  location 
of  instrument. 


LED  -  Cross  check  was  less  because 
of  its  poor  location,  out  of 
scan . 


Location  of  LED  —  also  was  hand 
flying  and  did  not  engage  auto 
pilot 


(64) 


(No  answer) 


Too  often,  however,  it  was  new  and 
I  consider  that  to  be  the  reason 
for  fixation. 


Question  13a  continued 


PILOT  #  RESPONSES  COMMENTS 


(72) 

IVSI : 

About  once  a  second 
or  every  two  to 
four  seconds 

LED: 

Less  than  once  in 
ten  seconds 

CRT: 

About  every  five 
to  ten  seconds 

Because  it  is  already  in  cross-check. 


13.  b)  When  in  a  conflict  situation? 

ABOUT  ONCE  EVERY  TWO  TO 

A  SECOND  FOUR  SECONDS 


IVSI: 

51% 

(29) 

46% 

(26) 

LED: 

44% 

(26) 

51% 

(30) 

CRT: 

38% 

(23) 

52% 

(32) 

ABOUT  EVERY 
FIVE  TO  TEN 
SECONDS 


LESS  THAN 
ONCE  IN 
TEN  SECONDS 


3% 

(2) 

0 

5% 

(3) 

0 

10% 

(6) 

0 

(Added  as  part  of  questionnaire  revision) 


PILOT  # 

RESPONSES 

(14) 

IVSI: 

About  once  a 

second 

LED: 

About  once  a 

second 

CRT: 

About  once  a 

second 

(40) 

IVSI: 

Every  two  to 
seconds 

four 

..LED : 

Every  two  to 
seconds 

four 

CRT: 

About  once  a 

second 

(62) 

IVSI: 

About  once  a 

seoncd 

LED: 

About  once  a 

second 

CRT: 

About  once  a 

second 

COMMENTS 

Probably  checked  it  too  often  to 
the  determent  of  primary  instru¬ 
ments. 

Found  myself  glued  to  the  CRT  when 
conflict  arose,  often  because  dis¬ 
play  was  small  and  difficult  to 
read. 


Requires  constant  attention  and 
detracts  from  heads  up  vigilance. 
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SECTION  IV 


This  section  examines  your  reaction  to  the  presentation  of  traffic 
advisories.  Traffic  advisories  are  given  on  the  LED  and  CRT  displays  only. 

14.  Were  traffic  advisories  presented  in  time  to  be  useful? 


ALWAYS  30% 

(22)  OFTEN 

56% 

(41)  SOMETIMES  14%  (10)  NEVER  0 

PILOT  # 

RESPONSES 

COMMENTS 

(4) 

Often 

Sometimes 

In  CRT 

In  LED 

(21) 

Always 

Often 

In  LED 

In  CRT 

(27) 

Yes 

Sometimes 

In  CRT 

In  LED 

(42) 

Sometimes 

Only  in  climb  and  descents 

(60) 

Always 

One  CRT  test  had  conflict  immediately 
upon  presentation. 

15. 

Were 

ATC? 

the  ASA  traffic  advisories 

as  useful  as  verbal  advisories  from 

MORE  ABOUT  AS 

USEFUL  USEFUL 

SELDOM  AS  NEVER  AS 

USEFUL  USEFUL 

LED: 

45% 

(33)  42% 

(31) 

10%  (8)  3%  (2) 

CRT: 

62% 

(46)  28% 

(21) 

7%  (5)  3%  (2) 

PILOT  # 

RESPONSES 

COMMENTS 

(14) 

LED: 

CRT: 

Seldom  as  useful 
More  useful 

With  LED,  it  took  time  to  inter¬ 
pret  and  convert.  Therefore,  more 
time  than  with  ATC  advisories. 

(66) 

LED: 

CRT: 

More  useful 
More  useful 

These  always  included  altitude. 
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16.  Were  the  ASA  traffic  advisories  presented  in  a  useful  format  on  the: 


LED: 

YES  84%  (54) 

NO 

16% 

(10) 

CRT: 

YES  86%  (55) 

NO 

14% 

(9) 

(Added  as 

part  of 

questionnaire  revision). 

PILOT  # 

RESPONSES 

COMMENTS 

(14) 

LED: 

f 

No 

Didn't  like  the  clock  position 

CRT: 

Yes 

and  range  arrangement . 

(16) 

LED: 

Yes 

CRT  -  except  in  active  mode 

CRT: 

Yes 

(21) 

LED: 

Yes 

CRT  -  less  so  than  on  LED 

CRT: 

Yes 

(27) 

LED: 

Yes 

LED  -  O.K. 

CRT: 

Yes 

CRT  -  Best 

(42) 

LED: 

No 

They  can  confuse  an  actual  alert. 

CRT: 

No 

(44) 

LED: 

Yes 

CRT  -  but  need  improvement. 

CRT: 

Yes 

(57) 

LED: 

Yes 

CRT  -  need  interpretation  - 

CRT: 

No 

increases  pilot  workload. 

(58) 

LED: 

Yes 

CRT  -  but  not  as  useful  to  me. 

CRT: 

Yes 

(59) 

LED: 

Yes 

LED  -  within  constraints  of 

CRT: 

Yes 

instrument. 

CRT  -  Map  format  easier  to 

interpret  quickly. 

(63) 

LED: 

Yes 

LED  -  active  mainly 

CRT: 

Yes 

(71) 

LED: 

Yes 

CRT  -  numbers  could  be  made  a 

CRT: 

Yes 

little  larger. 

(72)  LED:  Yes  CRT  -  best 

CRT:  Yes 

(74)  LED:  Yes  LED  -  hard  to  interpret  quickly. 

CRT:  Yes 


D-35 


17.  Should  the  altitude  of  other  aircraft  be  given  in  MSL  or  relative 
to  your  own  aircraft? 

MSL  89%  (66) 

RELATIVE  11%  (8) 

ALTITUDE  INFORMATION  NOT  REQUIRED  0 


PILOT# 

RESPONSES 

COMMENTS 

(6) 

MSL 

In  some  parts  of  the  world,  altimeter 
settings  are  given  so  that  when  the 
airplane  lands,  it  indicates  an 
elevation  of  zero,  regardless  of  what 
the  actual  field  evaluation  is. 

(10) 

MSL 

Relative  would  need  to  know  +/- 

(16) 

MSL 

To  correlate  with  ATC  information. 

(48) 

RELATIVE 

Perhaps  altitude  information  not 
required. 

(66) 

MSL 

Much  easier  to  relate  to  MSL. 

18.  How  does  ASA  advisories  affect  your  workload  as  compared  to  the 
current  advisories  from  ATC? 

UNACCEPTABLE  ACCEPTABLE 

INCREASE  IN  INCREASE  IN 

WORKLOAD  WORKLOAD 

LED;  7%  (5)  71%  (51) 

CRT:  13%  (9)  65%  (47) 

PILOT#  RESPONSES 


(6)  LED:  Acceptable  increase 

in  workload. 

CRT:  Acceptable  increase 
in  workload. 


NO  EFFECT 
ON  WORKLOAD 
WORKLOAD 


SMALL  LARGE 

DECREASE  DECREASE 

IN  WORKLOAD  IN  WORKLOAD 


13%  (9) 
15%  (11) 


8%  (6) 
3%  (2) 


1%  (1) 
4%  (3) 


COMMENTS 


The  continuous  aural  warning  of  the 
altitude  alert  is  very  distracting. 
There  should  be  a  precedence  and 
warnings,  i.e.;  the  lesser  precedence 
should  be  cut  out  until  the  primary 
is  taken  care  of.  The  GPWS  should 
be  included  in  precedence  of  warning 
system. 
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Question  #18  continued 


PILOT# 

RESPONSES 

COMMENTS 

(14) 

LED:  Between  Acceptable 
and  Unacceptable  increase 
in  workload. 

CRT:  Acceptable  increase 
in  workload. 

LED  -  possible  increase  due  to  lack 
of  familiarity  with  LED  device. 

(23) 

(No  answer) 

The  'orkload  given  in  the  simulator 
exercise  was  acceptable.  I  believe 
that  the  conflicting  traffic  at 
certain  times  in  certain  high  density 
traffic  areas  may  increase  the  pilots 
workload  beyond  the  acceptable  point, 
i.e.,  Taking  off  on  runway  1  at  SFO 
into  traffic  at  both  Alameda  and 
Oakland. 

(32) 

(No  answer) 

System  came  to  be  depended  upon  as 
another  tool.  Felt  comfortable  with 
it,  however,  it  would  be  difficult 
to  ascertain  effect  on  workload. 
Suggest  getting  some  very  fatigued 
pilots  to  fly  the  systems. 

(36) 

LED:  Acceptable  increase 
in  workload. 

CRT:  Acceptable  increase 
in  workload. 

Why  not  both? 

(43) 

LED:  Acceptable  increase 
in  workload. 

CRT:  Acceptable  increase 
in  workload. 

ASA  is  believable  and  I'm  thinking 
about  the  traffic  and  what  I'm  going 
to  do.  Verbal  advisories  mean  I  look 
out  for  awhile  and  worry,  but  don't 
really  work  much  harder.  (Assume  I 
don't  have  conflict  in  former  and 
visual  contact  in  latter.) 

(51) 

LED:  Acceptable  increase 
in  workload. 

CRT:  Acceptable  increase 
in  workload. 

Distracting  sometimes. 

(60) 


LED:  Acceptable  increase  CRT  data  can  be  assimilated  and 
in  workload.  used  immediately. 

CRT:  No  effect  on  workload. 


19.  During  this  simulation,  were  you  able  to  visually  acquire  traffic 
and  quickly  correlate  it  with  the  advisories  presented  on  the: 


OFTEN  SOMETIMES  NEVER 

LED:  32%  (24)  58%  (43)  10%  (7) 

CRT :  37%  (27)  57%  (42)  6%  (5) 


PILOT  # 

RESPONSES 

COMMENTS 

(6) 

LED:  Never 

CRT :  Sometimes 

From  pilot's  seat,  light  from  the 
instructor’s  panel  caused  a  reflec¬ 
tion  on  windshield  to  block  out  side 
view  of  a  small  part  of  the  pilot's 
windshield  effectively. 

(8) 

LED :  Never 

CRT:  Never 

No  visual  contact. 

(61) 

LED:  Sometimes 

CRT:  Often 

One  target  appeared  on  CRT, 
on  top  of  aircraft  and  wasn1 
until  after  evasion. 

directly 

1 1  seen 

20.  Would  the  display  help  you  locate  traffic  you  would  not  normally  use? 

OFTEN  SOMETIMES  NEVER 

LED:  43%  (31)  53%  (39)  4%  (3) 

CRT:  49%  (36)  48%  (35)  3%  (2) 

PILOT# 

(8) 

(9) 

(32) 

spent  a  great  deal  of  time  concen¬ 
trating  on  flying  aircraft.  Ergo, 
system  was  extremely  helpful. 


RESPONSES 

COMMENTS 

LED :  Never 

CRT:  Never 

No  visual  contact. 

LED:  Sometimes 

CRT:  Sometimes 

Hard  to  judge. 

LED:  Never 

CRT:  Never 

Please  remember  that  aircraft  was 
somewhat  strange  to  me ,  therefore 

_ _ _ _ _ : 
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21.  Do  you  feel  some  form  of  traffic  advisories  are  an  essential  part 
of  ASA? 

YES  92%  (57)  NO  8%  (5) 

(Added  as  part  of  questionnaire  revision) 


PILOT  # 

RESPONSES 

COMMENTS 

(31) 

Yes 

Especially  during  IFR  condition. 

(50) 

Possibly 

Not  essential,  but  a  good  idea. 

(66) 

Yes 

Gives  you  much  more  confidence 
in  the  maneuvers  that  are  presented. 

22.  Were  more  aircraft  advisories  than  necessary  displayed  on  the: 


OFTEN 

SOMETIMES 

NEVER 

LED: 

14%  (10) 

41% 

(30) 

45%  (33) 

CRT: 

3%  (2) 

42% 

(30) 

55%  (40) 

PILOT  # 

RESPONSES 

COMMENTS 

(22) 

LED:  Sometimes 

Yes  -  on  parallel  approaches. 

CRT:  Sometimes 

(60) 

LED:  Sometimes 

With  exception 

of  dual  approaches 

CRT:  Sometimes 

to  parallel  runways. 

(72) 

LED:  Often 

Due  to  easier 

interpretation  of 

CRT:  Never 

CRT  display. 

23.  A  recommended  maximum  number  of  aircraft  advisories  to  be  simul¬ 
taneously  displayed  is: 


PILOT  # 

RESPONSES 

COMMENTS 

(2) 

LED:  2 

CRT:  2 

Maximum;  more  clutters  presentation. 

(40) 

LED:  I 

The  closest  one 

(46) 

LED:  2 

CRT:  No  limit 

(64) 

(No  answer) 

All  that  are  in  conflict  plus  those 
that  will  be  predicated  on  maneuver 
commands  given  by  ASA. 

(67) 

LED:  All 

CRT:  All 

(68) 

(No  answer) 

Any  aircraft  that  is  a  threat  should 
be  displayed. 

(72) 

LED: Only  closest  one 
CRT: Up  to  four 
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UNCLASSIFIED  1343-01-3-2058-VOL-2  FAA/RD  -79-124-2  NL 


24.  When  a  conflict  occurred,  were  you  concerned  about  maneuvering  into 
other  traffic  during  the  escape  maneuver?  With  the: 


ALWAYS  OFTEN  SOMETIMES  NEVER 


IVSI :  18% 
LED:  10% 
CRT:  10% 

(13) 

(7) 

(7) 

23% 

20% 

11% 

(17) 

(15) 

(8) 

37%  (27) 

47%  (35) 

38%  (28) 

22%  (16) 

23%  (17) 

41%  (30) 

PILOT  # 

RESPONSES 

COMMENTS 

(11) 

IVSI: 

Often 

Possibly  natural 

LED: 

Often 

CRT: 

Often 

(14) 

IVSI: 

Sometimes 

CRT  -  once  at  a  ' 

very  short  range 

LED: 

Sometimes 

to  target. 

CRT: 

Once 

(30) 

IVSI: 

Sometimes 

When  only  one  can  be  displayed 

LED: 

Never 

that  possibility 

exists. 

CRT: 

Never 

(43) 

IVSI: 

Never 

Assumed  that  ASA 

would  keep  me 

LED: 

Never 

out  of  trouble  in  all  cases, 

CRT: 

Never 

assuming  that  I 

followed  its 

advice /command . 

25. 

Did  the  intruder  position  information  provide  enough  information  to 
allow  you  to  minimize  the  deviation  from  your  planned  flight  path? 

ALWAYS 

OFTEN 

SOMETIMES  NEVER 

IVSI 

:  12% 

(9) 

40%  (29) 

45%  (33)  3%  (2) 

CRT: 

22% 

(16) 

53%  (39) 

23%  (17)  2%  (1) 

PILOT  # 

RESPONSES 

COMMENTS 

(1) 

LED: 

CRT: 

Sometimes 

Often 

LED  took  too  long  to  interpret 
partly  because  of  format.  Took 
pilot's  attention  away  from  flying 

(20) 

LED: 

CRT: 

Often 

Always 

With  both,  a  trend  must  be  noted 
and  mentally  compacted. 

(43) 

LED: 

CRT: 

Sometimes 

Sometimes 

Didn ' t  worry  much  about  deviation . 
First  things  first. 
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26.  Was  your  response  to  an  ASA  command  different  in  IMC  versus  your 
response  in  VMC  with  the : 


ALWAYS  OFTEN  SOMETIMES  NEVER 


IVSI: 

12% 

(8) 

12% 

(8) 

42% 

(28) 

34% 

(23) 

LED: 

9% 

(6) 

12% 

(8) 

50% 

(34) 

29% 

(20) 

CRT: 

9% 

(6) 

16% 

(11) 

46% 

(31) 

29% 

(19) 

Please  comment  on  your  answers. 


PILOT  # 

RESPONSE 

COMMENTS 

(2) 

IVSI: 

Never 

No  difference  at  all.  Respond  to 

LED: 

Never 

coimvand  in  same  manner  under  both 

CRT: 

Never 

conditions. 

(6) 

IVSI: 

Never 

Because  depth  and  distance  percep¬ 

LED: 

Never 

tion  is  poor  in  a  night  environment. 

CRT: 

Never 

I  would  tend  to  rely  on  the  instru- 

ment  instructions  as  long  as  I  had 
confidence  in  them. 


(7) 

IVSI: 

Never 

Tried  to  follow  commands  called  for. 

LED: 

Never 

CRT: 

Never 

(10) 

IVSI: 

Never 

Night  flight  essentially  instrument. 

LED: 

Never 

All  instrumentation  and  human  senses 

CRT: 

Never 

are  adjunct,  best  used  collectively. 

(11) 

IVSI: 

Sometimes 

I  think  you  always  feel  somewhat 

LED: 

Sometimes 

better  when  you  see  traffic. 

CRT: 

Sometimes 

(12) 

TVSI: 

Sometimes 

Several  times  I  anticipated  a  command 

LED: 

Sometimes 

and  did  not  get  one.  This  was  usually 

CRT: 

Sometimes 

true  if  the  traffic  was  either  sighted 
or  called  by  ATC. 

(13) 

(No  answer) 

I  do  not  recall  the  difference. 

The  CRT  does  not  have  the  ambiguity 
present  in  the  other  displays  notably 
the  IVSI.  No  building  of  the  traffic 
picture  is  required.  You  have  it  in 
front  of  you. 


(14) 


IVSI:  Never 
LED:  Never 
CRT:  Often 


COMMENTS 


Question  #26  continued 


PILOT  #  RESPONSE 


(15) 

IVSI : 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(16) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(17) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(21) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(23) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(24) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(25) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(26) 

IVSI: 

Never 

LED : 

Never 

CRT: 

Never 

Because  in  the  clouds  I  have  to 
rely  either  upon  ATC  or  my  ASA 
instruments.  Out  of  the  clouds, 
I  would  look  visually  to  back  up 
but  not  deter  a  movement  away 
from  a  conflict. 

If  bearing  to  aircraft  is  known, 
this  would  affect  the  response. 


If  visual,  I  would  usually  take  a 
quick  look  to  try  for  visual 
separation.  Also  in  IMC,  thought 
was  given  before  descent. 

If  the  intruder  could  be  acquired 
visually,  I  had  more  confidence  in 
the  escape  maneuver  or  negative  command. 

Quite  often  after  making  the  correction 
called  for  on  any  ASA  device ,  you  did 
not  have  adequate  additional  visual 
information  to  feel  that  you  could 
override  the  avoidance  maneuver  called 
for  by  the  CAD  (Collision  Avoidance 
Device ) . 

VFR  you  are  able  to  clear  yourself 
on  turns  and  descent  from  terrain 
and  other  traffic.  IFR  you  must  check 
minimum  obstruction  altitude  which 
may  not  be  available  in  mountainous 
terrain  off  airways. 

Low  altitude  VFR,  you  tend  to  "see" 
target  and  not  react  as  rapidly 
as  in  IFR. 

No  conflict  IFR  or  VFR. 


J 
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COMMENTS 


Question  #26  continued 


PILOT  # 

RESPONSE 

(28) 

IVSI : 

Always 

LED: 

Always 

CRT: 

Always 

(29) 

IVSI: 

Never 

LED: 

Never 

CRT: 

Never 

(30) 

IVSI: 

Always 

LED: 

Always 

CRT: 

Always 

(31) 

IVSI: 

Never 

LED: 

Never 

CRT: 

Never 

(32) 

IVSI: 

Never 

LED: 

Never 

CRT: 

Never 

(33) 

IVSI: 

Often 

LED: 

Often 

CRT: 

Often 

(35) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(36) 

IVSI: 

Always 

LED: 

Always 

CRT: 

Always 

(38) 

IVSI: 

Never 

LED: 

Never 

CRT: 

Soroeti 

To  visually  confirm  that  the 
instrument  says  -  made  the  response 
with  more  confidence. 

The  CRT  gives  a  better  picture  of 
your  situation,  and  can  show  more 
aircraft  with  less  confusion;  with 
exposure,  it  would  be  very  easy  to 
work  with. 

When  IMC,  1  am  unable  to  visually 
find  him  and  would  take  immediate 
action.  In  visual  conditions,  the 
action  might  be  tempered  because 
of  visual  contact. 

The  ASA  command  supplemented  the 
response  in  VMC. 


Determined  that  at  night  it  is  almost 
impossible  to  ascertain  relative 
distance.  Therefore,  felt  required 
to  obey  commands. 

Need  visual  contact  in  VMC  to 
smoothly  avoid  conflict. 


One  test  in  a  simulator  is  not 
adequate  to  establish  this.  Simulators 
require  considerable  more  attention 
to  the  instruments  than  an  airplane. 
There  isn't  a  "true"  visual  situation 
in  a  simulator  due  to  this  shortcoming. 

I  feel  that  three  sets  of  eyes  VMC 
looking  for  the  intruder  would  be 
much  better  them  having  only  an 
instrument  in  IMC. 

Not  knowing  the  azimuth  created 
some  doubt  as  to  action  required. 
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Question  #26  continued 


PILOT  # 

RESPONSE 

COMMENTS 

(41) 

IVSI : 

Sometimes 

While  flying  in  F/0  seat,  traffic 

LED: 

Sometimes 

appeared  to  be  unrealistic  (diving 

CRT: 

Sometimes 

at  a  very  fast  rate). 

(42) 

IVSI: 

Never 

It  might  be  different  in  an  actual 

LED: 

Never 

aircraft  as  the  simulator  is  not 

CRT: 

Never 

the  real  world. 

(43) 

IVSI: 

Often 

VMC  is  not  really  so  with  this 

LED: 

Often 

simulator.  In  a  real  life  situation 

CRT: 

Often 

(especially  daytime) ,  I  think  response 
to  ASA  might  be  tempered  greatly  if 
the  intruder  was  clearly  visible. 

(44) 

IVSI: 

Often 

IVSI  -  command  without  situation 

LED: 

Sometimes 

difficult  to  modulate. 

LED  -  situation  allowed  some 
maneuvering  prior  to  command. 

(46) 

IVSI: 

Sometimes 

With  intruder  in  sight,  deviations 

LED: 

Sometimes 

tended  to  be  slower  and  less  extreme. 

CRT: 

Sometimes 

(47) 

IVSI: 

Always 

IFR,  I  followed  commands  because 

LED: 

Always 

I  could  not  see  other  traffic. 

CRT: 

Always 

(48) 

IVSI: 

Never 

Alert  aural  warnings  are  most  important. 

LED: 

Sometimes 

CRT: 

Sometimes 

(49) 

IVSI: 

Often 

I  would  usually  look  out  during 

LED: 

Often 

evasive  maneuver. 

CRT: 

Often 

(51) 

(No  answer) 

First  experience  in  simulation  makes 
answering  difficult  to  this  question. 

Perhaps  "sometimes"  but  recalling 
response  afterward  is  difficult  to 
accurately  answer. 

(53) 

IVSI: 

Sometimes 

I  used  less  evasive  control  when 

LED: 

Sometimes 

in  VMC.  I  think.  | 

CRT: 

Sometimes 
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COMMENTS 


Question  #26  continued 


PILOT  # 

RESPONSE 

(57) 

IVSI: 

Often 

LED: 

Often 

CRT: 

Often 

(58) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(59) 

IVSI: 

Often 

LED: 

Sometimes 

CRT: 

Sometimes 

(60) 

IVSI: 

Always 

LED: 

Sometimes 

CRT: 

Never 

(61) 

(No  answer 

(63) 

IVSI: 

Always 

LED: 

Always 

CRT: 

Always 

(64) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

CRT  display  seems  least  desirable. 
Requires  concentration  to  interpret, 
need  constant  reference  to  target 
to  estimate  its  threat  potential, 
too  much  head  down  time. 

When  aircraft  was  sighted  visually, 

I  cross  checked  it  frequently  with 
display  visually. 

The  visual  acquisition  of  a  target 
allows  a  "graded"  (gentle  or  rapid) 
maneuver  depending  upon  location  and 
collision  potential.  Sometimes 
turning  away  from  a  target  removes 
him  from  visual  contact,  whereas  a 
climbing  or  descending  turn  toward 
the  target  may  reduce  the  collision 
potential  because  you  can  keep  him 
in  sight. 

To  me,  the  CRT  enables  your  eyeballs 
to  immediately  see  the  situation,  VMC 
or  IMC.  I  would  be  hesitant  in  IMC 
to  enter  airspace  other  than  my  own 
when  using  the  IVSI. 

Don't  feel  justified  in  making  a 
decision  between  the  two  based  on  the 
simulation.  Would  seem  obvious,  that 
in  VFR  conditions  one  would  be  able 
to  modify  actions  based  on  observation 
of  conflicting  aircraft,  if  seen  when 
alert  was  given. 

LED  -  If  you  need  to  present  more 
than  (1)  aircraft,  then  allow  more 
space  between  the  print-out.  During 
the  flight  (3)  were  presented  at  once 
which  was  too  much  to  untangle . 

A  bold  new  concept  to  gain  confidence 
in,  when  flying  IMC  -  may  be  a 
detractor  in  VMC  conditions,  however, 
if  in  a  heads  up  display,  you  may 
alleviate  the  detraction  in  VMC. 
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COMMENTS 


Question  #26  continued 


PILOT  # 

RESPONSE 

(65) 

IVSI : 

Always 

LED: 

Always 

CRT: 

Always 

(66) 

IVSI: 

Never 

LED: 

Sometimes 

CRT: 

Often 

(69) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(70) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(72) 

IVSI: 

Sometimes 

LED: 

Sometimes 

CRT: 

Sometimes 

(73) 

IVSI: 

Often 

LED: 

Often 

CRT: 

Often 

(74) 

IVSI: 

Never 

LED: 

Never 

CRT: 

Sometimes 

Not  seeing  the  intruder  made  me 
react  faster;  then  I  tended  to  over¬ 
control,  i.e.,  pitch  and  bank. 

The  more  information  you  have  about 
the  traffic,  the  more  you  would 
vary  your  responses  urider  conditions 
of  not  seeing  the  traffic  versus  see¬ 
ing  the  traffic. 

It's  rattling  to  have  an  intruder 
advisory  while  in  IMC.  Is  the 
advisory  real  or  false? 

I'm  sure  if  I  saw  the  traffic  in 
VMC ,  I  could  better  relate  to 
avoiding  it,  but  just  having  a  CAS 
there  would  alert  me  to  the  many 
other  aircraft  that  one  fails  to 
see  when  doing  other  cockpit  duties. 

The  CRT  is  by  far  the  best  way  to 
stay  in  the  information  loop  and 
keep  track  of  the  traffic  situation 
as  it  develops. 

Not  being  able  to  possibly  "see" 
the  traffic  increases  speed  desire 
to  react. 

The  CRT  not  only  gives  the  numbers 
but  gives  the  pilot  good  information 
on  track  of  intruder  and  his  change 
in  altitude. 


D-47 


Section  V 


This  section  examines  your  reaction  to  the  presentation  of  positive, 
negative  and  limit  maneuver  commands. 


27.  Do  you  feel  that  the  commands  are  presented  in  sufficient  time  to 
avoid  a  potential  collision? 

ALWAYS  OFTEN  SOMETIMES  NEVER 


IVSI: 

58% 

(42) 

35% 

(25) 

7% 

(5) 

0 

LED: 

56% 

(41) 

28% 

(28) 

6% 

(4) 

0 

CRT: 

53% 

(39) 

37% 

(27) 

10% 

(7) 

0 

PILOT  # 


RESPONSE 


COMMENTS 


(63)  IVSI : 

LED: 

CRT: 

passengers  any  more  than  necessary? 
If  it  says  go  down  first,  say,  how 
fast,  to  avoid  a  collision. 


Always 

Always 

Always 


I  hope  so.  The  point  here  again, 
is  the  degree  of  maneuvering  required 
to  avoid  a  collision.  Why  upset  the 


28.  Did  you  agree  with  the  maneuver  command  given? 

ALWAYS  42%  (30)  OFTEN  57%  (41) 

SELDOM  1%  (1)  NEVER  0 


PILOT  # 


RESPONSE 


COMMENTS 


(6) 


Always 


(10) 


Often 


I  suppose  I  agree  because  I'm  not 
sure  we  have  sufficient  information 
to  agree  or  disagree.  One  exception 
was  the  IVSI,  where  3  signals  did 
not  seem  to  agree,  (i.e.,  descent, 
max  500  climb,  descent  in  quick 
succession) . 

Interpretive  decisions  possible 
and  valid  in  this  test. 


(11) 


Often 


CRT  tends  to  confuse  you  some  in 
turn . 
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COMMENTS 


Question  #28  continued 


PILOT  #  RESPONSE 

(64)  Often 


(66) 


Often 


However,  not  enough  exposure  to 
system  to  thoroughly  understand 
its  capability. 

More  with  the  CRT  them  the  LED. 


29 .  Which  system  do  you  feel  presented  the  most  accurately  determined 
maneuver  commands? 

IVSI  23%  (16)  LED  37%  (26)  CRT  40%  (28) 


PILOT  #  RESPONSE 

(5)  IVSI 

(6)  (No  answer) 


(11)  IVSI 

LED 
CRT 


(19)  IVSI 


(23) 


IVSI  &  CTY 


COMMENTS 

They  were  all  accurate?  however,  the 
IVSI  commands  are  sinpler,  given 
within  the  normal  instrument  scan, 
with  subsequent  immediate  response. 

I  felt  LED  and  CRT  were  about  the 
same,  but  I  thought  LED  gave 
sufficient  information,  more  com¬ 
pactly  and  was  easier  to  include 
in  scan. 

Easy  to  follow,  LED 
Easy  to  follow 

Probably  most  accurate  but  not  as 
easy  to  follow. 

However,  LED  excellent  if  positioned 
in  a  more  desirable  central  cockpit 
position  in  front  of  yoke. 

Were  equal 
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30.  Are  all  of  the  command  types  necessary? 


YES  NO 


Positive  Commands 

97% 

(61) 

3% 

(2) 

Negative  Commands 

77% 

(47) 

23% 

(14) 

Limit  Commands 

87% 

(53) 

13% 

(8) 

PILOT  # 
(5) 


(14) 


RESPONSE 


COMMENTS 


Positive  Commands 
Negative  Commands 

Limit  Commands 


Yes 

Yes  —  Would  rather  call  this  an 
"advisory"  or  some  similar  wording. 
Yes 


(No  answer)  I  didn't  like  the  use  of  the  term, 

limit  1000  etc.  I’d  rather  see  a 
minimum  rate  required  or  simply 
don't  climb  or  descend. 


31. 

When  presented  with  negative  commands,  were  you  able 
your  intended  flight  path  without  an  ATC  call? 

to  continue 

ALWAYS  7%  (5) 

OFTEN  41%  (31) 

SOMETIMES  49%  (36) 

NEVER  3%  (2) 

PILOT  #  RESPONSE 

COMMENTS 

(10) 

Often 

Missed  continuing 
cleared  altitude, 
cleared  altitude. 

to  previously 
leveled  at  prior 

32. 

When  presented  with  limit  commands ,  were  you  able  to 
original  flight  path  without  a  call  to  ATC? 

continue  your 

ALWAYS  4%  (3) 

OFTEN  45%  (33) 

SOMETIMES  46%  (34) 

NEVER  5%  (4) 

33.  Did  any  of  the  displays  cause  you  to  make  larger  than  normal  (1/4G) 
vertical  accelerations? 


ALWAYS  OFTEN  SOMETIMES  NEVER 


IVSI: 

0 

22% 

(15) 

40% 

(27) 

38% 

(26) 

LED: 

1%  (1) 

16% 

(11) 

47% 

(33) 

36% 

(25) 

CRT: 

0 

13% 

(9) 

42% 

(29) 

45% 

(31) 

PILOT# 

RESPONSES 

COMMENTS 

(6) 

IVSI: 

Never 

Really  hard  to  tell 

LED: 

Sometimes 

CRT: 

Sometimes 

(11) 

IVSI: 

Sometimes 

But  I  think  it  was  me  more  than 

LED: 

Sometimes 

the  instrument. 

CRT: 

Sometimes 

(32) 

IVSI: 

Sometimes 

Must  qualify  this  because  aircraft 

LED: 

Sometimes 

was  strange  to  me. 

CRT: 

Sometimes 

(40) 

IVSI: 

Often 

Reaction  time  to  CRT  was  too  slow. 

LED: 

Often 

CRT: 

Sometimes 

(44) 

IVSI: 

Never 

Any  G >. 75  due  to  pilot  technique. 

LED: 

Never 

CRT: 

Never 

34.  Did  any  of  the  displays  cause  you  to  make  a  steeper  than  normal 


(30° 

or  3°/sec) 

bank  to  avoid 

another  aircraft? 

ALWAYS 

OFTEN 

SOMETIMES 

NEVER 

IVSI 

:  0 

3% 

(2) 

14%  (10) 

83% 

(59) 

LED: 

0 

6% 

(4) 

11%  (8) 

83% 

(60) 

CRT: 

0 

6% 

(4) 

17%  (12) 

77% 

(55) 

PILOT  # 

RESPONSES 

COMMENTS 

(6) 


IVSI 

LED: 

CRT: 


Never 

Never 

Never 


Really  hard  to  tell 


Question  #34  continued 


PILOT  # 

RESPONSE 

COMMENTS 

(11) 

IVSI : 

(No  answer) 

Only  when  I  looked  up  on  scan 

LED: 

(No  answer) 

CRT: 

(No  answer) 

(40) 

IVSI: 

Sometimes 

Simulator  characteristic 

LED: 

Sometimes 

CRT: 

Sometimes 

(44) 

IVSI: 

Never 

Bank  angles  exceeded  30°  on 

LED: 

Never 

occasion  again,  pilot  technique/ 

CRT: 

Never 

not  familiar  with  simulator 

(70) 

IVSI: 

Sometimes 

Not  intentional  anyway 

LED: 

Never 

CRT: 

Never 
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SECTION  VI 


This  section  examines  your  reaction  to  the  current  ASA  concept. 


35.  Because  the  ASA  system  does  not  consider  the  intentions  of  your  own 
or  the  other  aircraft,  it  may  present  a  maneuver  command  which  would 
normally  be  resolved  by  the  planned  action  of  either  or  both  air¬ 
craft.  Did  you  see  this  situation  during  your  flight?  With  the: 


ALWAYS  OFTEN  SOMETIMES  NEVER 


IVSI: 

3%  (2) 

6% 

(4) 

41% 

(26) 

50% 

(32) 

LED: 

0 

9* 

(6) 

55% 

(37) 

36% 

(24) 

CRT: 

2%  (1) 

13% 

(9) 

54% 

(37) 

31% 

(21) 

PILOT  # 


RESPONSE 


(11) 


(No  answer) 


(44) 


IVSI :  Never 

LED:  Sometimes 

CRT:  Sometimes 


COMMENTS 


Possibility  always  exist  -  did 
not  notice  any  difference  in 
this  respect. 

If  CRT  presented  path  predictors 
it  would  be  better. 


(60) 


IVSI :  Sometimes 
LED:  Sometimes 
CRT:  Sometimes 


Parallel  approaches 


36.  What  effect  does  the  ASA  system  have  on  your  confidence  when  over¬ 
flying/underflying  another  aircraft  by  1000  feet? 


IVSI: 

Increased  Confidence 

47% 

(34) 

Less  Confidence 

7% 

(5) 

No  Change 

46% 

(33) 

LED: 

Increased  Confidence 

71% 

(52) 

Less  Confidence 

3% 

(2) 

No  Change 

26% 

(19) 

CRT: 

Increased  Confidence 

71% 

(52) 

less  Confidence 

8% 

(6) 

No  Change 

21% 

(15) 
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PILOT  # 


RESPONSE 


COMMENTS 


(49) 

IVSI : 

No  change 

LED: 

No  change 

CRT: 

No  change 

(66) 

IVSI: 

No  change 

LED: 

More  confidence 

CRT: 

More  confidence 

37.  Do  you  feel  that  use  of  the  ASA 


With  use  could  increase  confidence 


LED:  you  know  his  altitude 
CRT:  you  know  his  altitude 


could  allow  reduced  separation?  Kith: 


MUCH 

REDUCED 


SOMEWHAT 

REDUCED 


NO 

REDUCTION 


INCREASED 

SEPARATION 


IVSI: 

0 

17% 

(12) 

83% 

(60) 

LED: 

1%  (1) 

32% 

(23) 

67% 

(49) 

CRT: 

10%  (7) 

33% 

(24) 

57% 

(42) 

PILOT  # 

RESPONSE 

COMMENTS 

(11) 

IVSI: 

No  reduction 

Very  doubtful 

LED: 

No  reduction 

CRT: 

No  reduction 

(33) 

IVSI: 

Somewhat  reduced 

If  with  better  readout 

LED: 

Somewhat  reduced 

CRT: 

Much  reduced 

38.  Do  you  feel  that  the  ASA  system  will  result  in  less  or  more 
communications  with  ATC? 

MUCH  LESS  4%  (3)  SOMEWHAT  LESS  31%  (23)  NO  CHANGE  13%  (10) 

SOMEWHAT  MORE  45%  (33)  MUCH  MORE  7%  (5) 


PILOT  # 
(10) 

(11) 


RESPONSE 
Somewhat  more 

Somewhat  more 


COMMENTS 

Advisory  of  action  (intended  or  taken) 
Very  doubtful 


Question  #38  continued 


PILOT  # 

RESPONSE 

COMMENTS 

(14) 

Somewhat  more 

Especially  until  crews  become 
more  adept. 

(21) 

Somewhat  more 

Due  to  calls  to  ATC  to  explain  non- 
compliance  with  clearances  if  the 
traffic  advisories  by  ATC  were 
transferred  to  the  ASA  system,  then 
communication  would  probably  be 
reduced.  I  would  have  more  con¬ 
fidence  in  a  reliable  ASA  system 
them  ATC. 

(28) 

Somewhat  more 

This  depends  on  experience  levei . 

It  probably  would  drop  with  time. 

(30) 

Somewhat  more 

If  we  must  explain  each  deviation 

(32) 

No  change 

It  is  my  opinion  that  any  other  than 
"normal"  behavior  by  aircraft  should 
be  reported  to  ATC. 

(66) 

Somewhat  less 

They  wouldn't  have  to  give  traffic 
advisories. 

39.  Do  you  feel  that  the  ASA  system  as  used  in  this  simulation  will  result 
in  safer  operation  in  respect  to  midair  collision? 


PILOT  # 
(1) 


(2) 


(3) 


(4) 


COMMENTS 


In  most  respects,  yes;  may  not  change  climb/descent 
accidents  and  may  reduce  overall  safety  due  to  increased 
cockpit  workload  and  interruption  of  normal  duties. 

Definitely  yes;  all  of  the  methods  of  presenting  the  ASA 
system  in  the  cockpit  are  an  aid,  although  the  CRT  gives 
the  best  overall  "picture". 

Don't  know;  if  aircraft  show  up  unexpectedly ,  without 
prior  ATC  notification,  maneuver  may  present  another 
hazard. 

Yes,  if  full  mode  and  displayed  on  CRT  can  be  used. 
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Question  tt 

PILOT  # 

(5) 

(7) 

(11) 

(15) 

(16) 

(17) 

(23) 

(24) 

(32) 

(39) 

(40) 

(49) 

(61) 

(63) 

(64) 


9  continued 


COMMENTS 


Yes,  the  "LED"  and  "CRT"  both  require  more  heads  i:>  the 
cockpit  to  monitor  tracked  traffic  at  a  time  when  eyes 
should  be  looking  out. 

Needs  refinement;  if  unable  to  contact  controller  due 
to  workload,  can  cause  concern. 

It  could. 

Some  form  certainly  wo.tld  be  a  help. 

This  system  would  aid  in  detection  of  other  aircraft; 
however,  in  the  terminal  area  there  may  be  too  many 
potential  conflicts. 

Depends  on  number  of  false  alarms. 

Yes,  any  one  of  the  systems  would  be  an  improvement  over 
what  we  have  now  -  nothing! 

Yes,  any  additional  warning  of  conflicting  traffic  makes 
a  safer  operation. 

Ask  PSA  about  San  Diego!  Of  course! 

Yes,  once  it's  flight  tested. 

Yes,  especially  in  VFR  conditions  with  generally  more 
aircraft  to  be  seen. 

Yes,  however,  I  would  like  to  see  the  parameters  kept 
to  a  point  that  false  signals  would  not  cut  the  usability 
of  the  system. 

Perhaps  -  as  pilots  we  are  slowly  gaining  more  confidence 
in  the  reliability  of  black  boxes. 

Yes,  but  not  for  many  years  to  come.  Most  of  the  midairs 
are  with  general  aviation  and  airline  or  military. 

?  may  cause  more  conflicts  than  it  resolves  especially 
in  high  density  areas. 
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Question  #39  continued 
PILOT  #  COMMENTS 

(66)  Yes,  if  the  crews  have  more  information  on  traffic 

there  will  be  fewer  midair  collisions. 

(69)  If  the  computer  program  in  the  box  is  valid,  and  if 

the  pilots  have  confidence  in  the  system  -  yes. 


40.  Did  the  active  mode  (regardless  of  display  type)  provide  enough 
information  to  avoid  a  collision? 


YES  86% 

(54) 

NO  14%  (9) 

(Added  as 

part 

of  questionnaire  revision) 

PILOT  # 

REVISION 

COMMENTS 

(11) 

Yes 

Better  in  full  mode 

(14) 

Yes 

Depending  on  weather  and 

crossing  angles 

(36) 

Yes 

Excluding  ATC  clearance 

(49) 

Yes 

But  kept  you  in  suspense 

(58) 

No 

Need  more  information 

(66) 

Yes 

But  it  was  more  like  the 

IVSI 

(69) 

Yes 

But  I  was  slow  to  follow 

(70) 

Yes 

In  most  cases,  but  prefer 

full  mode 
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41.  Rate  the  following  items  in  relative  importance  to  resolution  of  a 
conflict.  (1  =  most  important,  11  =  least  important) 

(Projected  miss  distance  was  added  to  list  of  elements,  and  "check 
if  essential"  was  included  as  part  of  questionnaire  revision). 

Rank  Check  if  Essential 


Altitude  of  other  aircraft 

1 

85% 

(53) 

Heading  of  other  aircraft 

4 

51% 

(31) 

Relative  bearing 

3 

59% 

(38) 

Range  of  other  aircraft 

2 

81% 

(50) 

Other  aircraft  type 

10 

5% 

(  3) 

Vertical  speed  of  other  aircraft 

7 

20% 

(12) 

Horizontal  closure  rate 

5 

21% 

(13) 

Vertical  closure  rate 

6 

17% 

(10) 

Closure  angle 

9 

7% 

J_il 

Other  aircraft  identity 

11 

3% 

(  2) 

Projected  miss  distance 

8 

14% 

(  8) 

PILOT  #  COMMENTS 

(1)  Relative  bearing  and  closure  rate  are  the  only  important 

factors.  If  relative  bearing  is  changing,  there  can  be 
no  conflict  and  if  closure  rate  is  negative,  there  can 
be  no  conflict. 


(2) 


Other  aircraft  identity  rated  4th  for  VMC. 


SECTION  VII 


This  section  allows  you  to  evaluate  the  displays. 


42.  a)  Based  on  this  simulation  period,  rate  the  displays  in  order 
of  preference.  (1-3  with  1  =  most  preferred) 


1-26%  (19) 

1-27%  (20) 

1-47%  (35) 

IVSI  _ 

2-27%  (20) 

LED  _ 

_  2-43%  (32) 

CRT  _ 

2-28%  (21) 

3-47%  (35) 

3-28%  (21) 

3-23%  (17) 

PILOT  # 
(5) 

(10) 

(21) 

(59) 

(61) 

(63) 

(71) 


COMMENTS 


1.3.2  with  respect  to  collision  avoidance;  3,2,1  with 
respect  to  traffic  information. 

2.3.1  IVSI  second  with  backup  LED  information. 

2.1.3  May  be  due  to  little  experience  with  CRT. 

3.2.1  if  located  in  better  position/with  color  commands 

3.2.1  with  a  more  noticeable  position  for  LED. 

3.1.2  Larger  display  only. 

3,2,1  I  have  mixed  opinion  here  -  I  like  the  simplicity 
of  the  IVSI,  that  is  the  least  distraction  from  other 
duties,  but  like  the  information  of  the  CRT  &  LED. 


b)  Would  your  second  choice  be  acceptable  if  the  first  were  not 
available? 


YES  96%  (69) 

PILOT  # 

RESPONSES 

(4) 

Yes 

(6) 

Yes 

(14) 

(No  answer) 

(46) 

(No  answer) 

NO  4%  (3) 

COMMENTS 

But  reluctantly  (LED) 

But  it  is  too  large  for  amount 
of  information  (CRT) 

Barely 

CRT  for  command  information, 

I  rate  3,  LED  2. 
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Question  #42  continued 

c)  If  the  quality  of  the  second  choice  were  improved,  and  given 
sufficient  practice,  would  the  second  choice  be  acceptable? 

YES  97%  (60)  NO  3%  (2) 

(Added  as  part  of  questionnaire  revision). 


PILOT  # 

(14) 

(44) 

(58) 

(66) 


RESPONSE 


(No  answer) 

Yes 

Yes 

(No  answer) 


COMMENTS 

Barely 

Probably  better 
Prefer  LED 
Possibly 


d)  Would  your  third  choice  be  acceptable  if  the  first  and  second 
choices  were  not  available? 


YES  73%  (53) 

PILOT  # 

RESPONSE 

(1) 

Yes 

(4) 

Yes 

(46) 

Yes 

(58) 

Yes 

(66) 

(No  answer) 

NO  27%  (20) 

COMMENTS 

Qualified  yes,  LED  display  needs 
better  readability  (LED) . 

But  reluctantly  (IVSI) 

For  information  but  not  command 

If  CRT  placement  improved  and 
enlarged  figures . 

It  would  be  better  than  nothing. 
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Question  #42  continued 

e)  If  the  quality  of  the  third  choice  were  improved,  and  given 
sufficient  practice ,  would  the  third  choice  be  acceptable? 

YES  83%  (48)  NO  17%  (10) 

(Added  as  part  of  questionnaire  revision). 


PILOT  # 

RESPONSE 

COMMENTS 

(21) 

Yes 

In  fact,  the  CRT  would  probably 
be  #1  with  enough  experience. 

(38) 

No 

Only  for  ground  capability  to 
avoid  takeoff  collisions. 

(46) 

(No  answer) 

CRT  good  for  information  -  inadequate 
for  command. 

(60) 

(No  answer) 

Maybe 

(61) 

Yes 

Include  selectability  of  climb 
limit  bands  and  noticeability  of 
no  turn  lights. 

(63) 

No 

I  won’t  accept  it  now  that  you've 
shown  the  other  two. 

(66) 

(No  answer) 

Not  as  acceptable  as  the  other  two. 
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43-  Do  you  feel  that  a  combination  of  display  devices  would  provide 
more  usable  information  than  the  best  test  display? 


NO  42%  (31) 

YES,  IVSI  and  LED  16%  (12) 


YES,  IVSI  and  CRT  27%  (20) 
YES,  LED  and  CRT  15%  (11) 


PILOT  # 
(1) 

(4) 

(12) 


(29) 


(61) 


(63) 


(74) 


REVISION 
(NO  answer) 

No 

Yes,  IVSI  &  CRT 


Yes,  IVSI  &  CRT 


Yes,  IVSI  &  CRT 


No 


No 


COMMENTS 


IVSI  for  active  and  CRT  for  full  mode 

CRT  would  do  if  full  mode 

This  combination  would  give  us 
more  information.  However,  I 
think  to  be  workable  in  our  pres¬ 
ent  system,  it  should  be  kept  as 
simple  as  possible. 

The  best  part  of  the  IVSI  is  the  good 
response  to  the  arrows,  if  they  were 
added  to  the  Cl  or  HSI,  with  the  CRT 
display  included,  to  supplement,  the 
combination  would  be  the  most  complete. 

CRT  would  be  superior  in  a  non-terminal 
area  environment  cruise  for  example. 
IVSI  would  be  superior  in  more  con¬ 
gested  areas,  as  you  would  normally 
be  including  it  in  your  cross  check 
and  wouldn 1 t  have  time  to  monitor 
another  interior  display. 

You  should  have  only  one.  With  more 
than  one  it  takes  away  from  the 
cross  check. 

Too  much  more  to  add  to  scan 
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SECTION  VIII 


This  section  asks  for  your  overall  comments  on  the  ASA  program. 
44.  What  comments  do  you  have  on  the  realism  of  this  simulation? 


PILOT  # 
(1) 

(2) 

(3) 

(4) 


(6) 

(7) 

(8) 

(9) 

(10) 
(ID 
(12) 

(13) 

(14) 


COMMENTS 


As  in  all  simulators,  the  acceleration  forces  of  real 
flight  are  missing;  and  also,  you  can't  really  look  for 
traffic  except  in  a  very  small  visual  segment. 

Very  well  done.  Real  scenarios.  Conflicts  presented 
as  in  true  developments. 

More  ATC  advisories  of  other  aircraft  and  better  visuals 
to  correlate  with  display. 

Very  realistic,  by  the  time  60-90  pilots  evaluate  the 
systems,  it  will  be  obvious  which  display  is  best.  It 
appears  that  if  the  system  selected  is  refined  to  work 
reliably,  pilots  will  probably  find  themselves  looking 
at  the  CAS  instead  of  out  the  window. 

Very  good 

A  good  start 

As  good  as  can  be  expected  without  actual  airborne  testing. 
Not  bad 

Reasonable  -  good  effects  throughout 

Very  well  done 

Excellent 

It  was  an  excellent  simulation. 

Fairly  good.  No  side  vision  is  a  real  deficiency. 

Possibly  a  practice  session  prior  to  test  with  each 
pilot  evaluating  all  displays  would  provide  a  more 
sensitive  test. 


Question  #44  continued 


PILOT# 

(15) 

(16) 

(17) 

(18) 

(19) 

(20) 
(21) 
(22) 

(23) 

(24) 

(25) 

(26) 

(27) 

(28) 

(29) 

(30) 

(31) 

(32) 

(33) 


COMMENTS 

Realism  was  very  good.  The  visual  cues  were  presented 
very  well. 

The  cockpit  environment  including  3  man  crews ,  distractions 
for  aircraft  problems ,  and  other  outside  factors  not 
included . 

95%  of  the  time,  very  good.  Some  extra  time  spent  with 
crew  coordination . 

Very  well  conceived  and  realistic  test. 

Excellent 

Good 

Excellent  simulation 
Very  good  simulation 
Fair 

Good  except  ability  to  see  VFR  traffic. 

Good,  realistic,  however,  the  program  has  to  keep  in  mind 
that  we  adapt  device  to  the  pilot,  not  the  pilot  to  the 
device . 

Realistic  as  electronic  automation  can  be. 

Realism  was  excellent. 

I  thought  the  realism  was  excellent. 

Very  realistic,  good  simulator,  program  well  thought  out. 
Excellent  realism 
Very  good 

No  comment  -  well  done 

Participating  crews  should  be  qualified  in  aircraft  first; 
need  more  practice  with  all  systems  before  answering  these 
questions. 


Question  #44  continued 


PILOT# 

(34) 

(35) 

(36) 

(37) 

(38) 

(39) 

(40) 

(41) 

(42) 

(43) 

(44) 

(45) 

(46) 

(47) 

(48) 

(49) 

(50) 

(51) 

(52) 


COMMENTS 


Visual  sightings  were  confusing  in  that  some  intruder 
lights  appeared  to  climb  &  dive  continuously  as  you 
watched  them. 

Rushed  -  otherwise  O.K. 

Good 

Satisfactory  simulation 
Good 

Good  but  still  has  to  be  flight  proven. 

Good 

Traffic  simulation  was  not  realistic 

Very  real  except  a  false  sense  of  security  in  the 
simulator,  I  would  not  feel  as  secure  in  an  actual 
aircraft. 

Very  realistic.  No  improvement  needed. 

Good 

Seemed  fairly  acceptable  as  realism  for  terminal  area. 
Good  simulation 
I  found  it  to  be  quite  real. 

Good 

Good  training  crew  did  excellent  job. 

Good 

Good,  the  system  helps  me  to  visualize  the  position, 
of  course,  closure  rate  of  an  intruder  more  rapidly. 

Very  realistic  -  from  ATC,  to  other  aircraft  -  radio 
traffic  clutter. 
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Question  #44  continued 


PILOT  # 

(53) 

(54) 

(55) 

(56) 

(57) 

(58) 

(59) 

(60) 
(61) 
(62) 

(63) 

(64) 

(65) 

(66) 

(67) 

(69) 

(70) 

(71) 


COMMENTS 
Very  good 

I  thought  it  was  realistic. 

Very  good  -  projects  a  good  idea  of  what  reality  would  be. 
Good  program 

Very  good  ATC  activity  and  CGI  traffic  provide  high 
degree  of  realism. 

Excellent 

Excellent  -  because  combined  head-up  and  head-down  with 
realistic  ATC  situation. 

Good 

Very  good,  for  conditions 
Excellent 

Very  well  prepared 

Very  good  -  except  for  density 

Excellent 

Very  realistic  especially  with  the  CGI  display  -  only 
problem  possibly  too  rushed. 

Acceptable 

Good  simulation  of  entire  trip. 

Much  better  than  I  thought  it  would  be  and  would  probably 
be  better  with  practice. 

Very  real 
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Question  #44  continued 


PILOT  # 

(72) 

(73) 

(74) 


COMMENTS 
Very  realistic 
Very  good 

I  thought  the  simulation  (especially  ATC)  was  very 
realistic 


45.  What  changes  would  be  required  in  ATC  operations  if  ASA  were  implemented? 


(Added  as  part  of  questionnaire  revision) . 


PILOT  # 
(11) 

(12) 


(14) 

(15) 

(16) 

(18) 

(19) 


COMMENTS 


Altitude  and  course  buffers  to  keep  from  turning  or  diving 
into  other  targets. 

A  provision  to  immediately  alert  ATC  of  a  deviation  from 
our  cleared  flight  path.  This  would  need  to  be  done 
other  than  verbal  due  to  inability  to  transmit  in  many 
terminal  areas.  Transponder  could  be  used. 

Flexibility 

More  communication  if  this  program  implemented. 

Possibly  might  allow  for  deletion  of  some  traffic  call 
outs;  however,  other  call  outs  of  traffic  may  be  necessary 
to  prevent  aircraft  from  making  unnecessary  evasions. 

May  require  fewer  aircraft  under  each  sector  controller. 

ASA  training 


(21) 


None  required.  However,  reduced  communication  and  sepa¬ 
ration  may  be  possible  in  some  situations. 


(22) 


I  hope  none. 


(23)  How  does  ATC  resolve  the  fact  that  numerous  deviations 

from  assigned  headings  and  altitudes  would  cause  serious 
interference  with  planned  traffic  flow. 


i-  it  wife 
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Question 

PILOT  # 

(24) 

(25) 

(26) 

(27) 

(28) 

(29) 

(30) 

(31) 

(32) 

(33) 

(35) 

(36) 

(37) 

(38) 

(40) 


#45  continued 


COMMENTS 

I  don't  know  of  any,  other  than  additional  deviations. 

Could  probably  get  rid  of  250  below  10,000  -  would 
increase  traffic  flow. 

Transponders  for  all  aircraft  in  the  sky. 

All  aircraft  would  be  required  to  comply  with  minimum 
equipment  to  be  located.  Transponder  and  altitude 
readout . 

Perhaps  less  advisories 
I'm  not  aware  of  any 
Very  little 
Very  little 

Feel  the  ATC  controller  was  acclimated  to  system.  Would 
be  interesting  to  place  an  uninitiated  controller  with 
fatigued  pilots. 

Participating  crews  should  be  more  aware  of  the  usage  of 
these  systems  before  using  them  in  an  ATC  environment. 

Strong  possibility  of  increased  separation  in  terminal 
areas. 

Leniency  in  violations 

ATC  will  question  the  pilots  action  in  many  cases. 
Loosening  of  regulations 

The  problem  of  what  to  do  regarding  returning  to  flight 
plan,  heading,  etc.  after  following  a  command  given  by 
one  of  displays. 
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Question  #45  continued 


PILOT  # 

(41) 

(42) 

(44) 

(45) 

(46) 

(47) 

(48) 

(49) 
(52) 


(53) 

(54) 

(55) 

(56) 

(57) 

(58) 

(59) 


COMMENTS 

1.  Level  at  an  altitude  above  or  below  when  climbing 
to  cleared  altitude. 

2.  Stopping  turns  before  reaching  a  vector  heading. 

Cut  down  on  controller  advisories 

Probably  some  changes  in  communications 

Possible  increased  separation  due  to  deviation  of  aircraft 

Have  to  assume  that  action  might  be  taken  without  ATC 
coordination  particularly  with  CRT  and  LED. 

None 

Perhaps  less  traffic  advisories  from  ATC. 

Emergency  evasive  action 

More  immediate  communication  from  flight  crews  advising 
ATC  of  course  and  altitude  changes  might  at  times  increase 
ATC  problems  -  ATC  reactions  to  a  possible  traffic  conflict 
could  possibly  be  different  because  of  their  knowledge  of 
a  more  expanded  traffic  picture. 

Much  less  radio  chatter  to  allow  for  communication  during 
a  conflict  deviation. 

I  think  the  ASA  would  not  require  any  changes  in  ATC 

None,  ASA  would  be  back  up 

None 

Spacing  would  have  to  provide  for  unanticipated  avoidance 
maneuvers  initiated  by  the  pilot. 

Very  little,  perhaps  more  traffic  identification 

Don't  feel  any.  Controllers  may  be  encouraged  to 
pass  more  of  the  traffic  separation  burden  to  the  pilot. 
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Question 
PILOT  # 
(60) 

(61) 

(63) 

(64) 

(65) 

(67) 

(68) 

(69) 

(70) 

(71) 

(72) 

(73) 

(74) 


#45  continued 


COMMENTS 


Terminal  areas  could  become  troublesome  due  to  many 
aircraft  in  small  area.  A  large  number  of  false  or 
unwarranted  warnings  would  have  the  effect  of  possibly 
allowing  operator  to  sometime  tune  out  the  warning  and 
pass  it  off  as  a  normal  conflict. 

You  would  have  more  chatter  between  crew  and  controllers 
to  verify  aircraft  under  positive  control,  i.e.  -  parallel 
approaches. 

Coordination  with  ATC  would  be  a  nightmare  with  2  or  more 
aircraft  changing  altitude  and  heading  during  busy  periods. 

Basic  change  in  primary  concept  and  design  of  the  ATC 
system  in  terminal  environment. 

Revamp 

None 

More  traffic  information  would  have  to  be  exchanged  with 
the  IVSI  system. 

As  with  ground  proximity  system  in  its  early  days,  I  would 
wonder  about  false  warnings  and  the  resulting  overload  on 
ATC. 


Deviation  from  assigned  altitude  without  prior  clearance 
from  hTC .  Especially  in  high  density  areas. 

Not  too  many  -  concern  about  avoiding  traffic  unnecessarily. 

Hard  for  me  to  foresee. 

Very  little 

None 
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46.  What  changes  would  be  required  in  aircraft  operating  procedures  if 
ASA  were  implemented? 


(Added  as  part  of  questionnaire  revision). 

PILOT  # 

COMMENTS 

(ID 

Added  duties  for  all  but  especially  non-flying  pilot 

(13) 

Very  little  or  none 

(14) 

Didn't  really  see  any 

(15) 

Including  ASA  in  scan 

(18) 

None 

(19) 

None 

(21) 

No  major  changes  required 

(22) 

Another  instrument  that  becomes  part  of  the  panel  scan. 
This  could  also  cause  more  eyes  in  the  cockpit  than 
outside  looking  for  traffic. 

(23) 

No  aircraft  should  be  allowed  into  a  high  density  traffic 
area  without  a  codad  transponder. 

(24) 

None 

(26) 

Transponders  for  all  aircraft 

(29) 

Shouldn't  require  any  changes 

(30) 

Use  of  F/E  to  monitor  the  display  and  help  interpret 

(32) 

Can  thinK  of  none,  now. 

(33) 

Passenger  seat  belt  would  be  on  more  of  the  time 

(35) 

S/O  required  to  monitor  CRT;  no  change  if  IVSI  used 

(36) 

None 

(38) 

None 

(42) 

None 
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Question 

#46  continued 

PILOT  # 

COMMENTS 

(43) 

None 

(45) 

None 

(46) 

Transmit 

(47) 

Very  little 

(48) 

None 

(50) 

Checklist  changes 

(52) 

None 

(53) 

None 

(55) 

None 

(56) 

None 

(57) 

Very  few  -  integration  of  ASA  utilization 

(58) 

Very  little 

(59) 

Closer  watch  on  ASA  displays 

(61) 

None 

(62) 

None 

(63) 

Keep  the  little  guy  under  more  restrictive  controls 

(67) 

ASA  training 

(68) 

None 

(69) 

Pilots  second  guessing 

(70) 

All  would  detract  from  visual  reference  in  VFR  conditions 
but  would  help  IFR.  Head  would  be  in  the  cockpit  more. 

(72) 

Crew  duties  defined  to  prevent  all  heads  in  cockpit  and  to 
insure  pilot  flying  is  not  diverted  from  basic  instrument  : 

(73) 

None 

(74) 

None 
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47 .  What 
ASA? 

PILOT  # 
(11) 

(12) 

(14) 

(15) 

(16) 

(17) 

(18) 

(20) 

(21) 

(22) 

(23) 

(24) 

(25) 

(26) 

(27) 


additional  test  do  you  recommend  be  conducted  before  implementing 
(Added  as  part  of  questionnaire  revision). 


COMMENTS 


Actual  flight  checks 

Training  of  pilots  to  be  familiar  with  system 

Extensive  in-flight  testing  to  provide  exposure  to 
all  possible  real  situations. 

Testing  aircraft  at  extreme  aircraft  limits  to  see  how 
it  would  react  to  commands  (i.e.,  climb  when  already 
at  high  altitude). 

Extensive  testing  in  terminal  areas. 

Line  operations 

Line  flight  evaluation  by  various  air  carriers 
Line  test 

Another  series  of  tests  (simulator)  like  this  one  plus 
in  flicflit  evaluation. 

Each  airline  should  have  an  ASA  installed  in  one  or  two 
aircraft  for  evaluation  of  all  the  pilots. 

See  if  there  really  will  not  be  an  oversaturation  on  the 
system  under  real  time  and  world  conditions. 

Use  in  high  density  areas  to  determine  number  of  false 
warnings . 

Extensive  flight  testing 

The  sooner  the  better!  Need  no  more  test  if  present 
instrumentation  proves  reliable. 

Hardware  must  be  refined  and  cost  accounting  be  evaluated 


(29) 


Testing  to  eliminate  false  signals.  If  the  system  gives 
false  signals,  the  pilots  will  lose  confidence  and  won't 
use  it. 


Question  #47  continued 


PILOT  # 

(30) 

(31) 

(32) 

(33) 

(34) 

(35) 

(36) 

(37) 

(38) 

(41) 

(42) 

(43) 

(44) 

(45) 

(46) 

(47) 

(52) 

(53) 


COMMENTS 


Test  in  aircraft 
Actual  flight 

Suggest  again,  closely  monitoring  reactions  of  fatigued 
pilots  and  controller  re:  UAL  at  Salt  Lake  City  12/18/77. 

More  practice 

Certainly;  get  the  hardware  and  see  if  it  works  in  the 
real  world. 

Much  greater  participation  by  line  and  management  pilots 
in  actually  flying  the  simulator.  A  minimum  of  5  flights 
for  each  type  of  display. 

Line  operation 

Must  be  tested  in  actual  environment 
Actual  condition  test 

Many  hours  experience  on  line  flights  before  installation 

Flight  tests 

None 

In  flight  tests 
Real  time  testing 

Better  displays-more  data-real  world  tests-through  training 
Flight  test 

The  LED  display  could  be  moved  to  be  included  in  instrument 
seem  for  more  rapid  recognition  of  advisory  and  other 
information . 

Reliability.  That  is  to  say  will  it  work  every  time  with 
very  few  false  activations.  Like  every  other  such  type 
of  instrument  system,  it  will  eventually  become  a  crutch 
and  therefore  be  regarded  as  reliable  by  air  crews  and 
controllers  alike.  It  must  be  believed  to  be  effective. 
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uestion  #47  continued 


48.  How  useful  do  you  feel  the  ASA  system  will  be  in  each  phase  of  flight? 


VERY 

MODERATELY 

NOT 

USEFUL 

USEFUL 

USEFUL 

UNDESIRABLE 

Takeoff 

22%  (14) 

37%  (23) 

35%  (22) 

6%  (4) 

Climb 

72%  (46) 

28%  (18) 

0 

0 

Cruise 

39%  (25) 

58%  (37) 

3%  (2) 

0 

Descent 

84%  (54) 

16%  (10) 

0 

0 

Approach 

72%  (46) 

26%  (17) 

2%  (1) 

0 

Landing 

29%  (18) 

31%  (19) 

34%  (21) 

6%  (4) 

(Added  as  part  of  questionnaire  revision) . 

PILOT  #  COMMENTS 

(40)  Nose  angle  in  climbout 

49.  What  type  of  maneuver  command  is  preferable  to  avoid  a  collision 
during  each  phase  of  flight? 


HORIZONTAL 

VERTICAL 

EITHER 

Takeoff 

63%  (39) 

13%  (8) 

24% 

(15) 

Climb 

24%  (15) 

19%  (12) 

57% 

(36) 

Cruise 

27%  (17) 

16%  (10) 

57% 

(36) 

Descent 

21%  (13) 

17%  (11) 

62% 

(38) 

Approach 

50%  (31) 

5%  (3) 

45% 

(28) 

Landing 

61%  (34) 

14%  (8) 

25% 

(14) 

(Added  as  part 

of  questionnaire  revision) . 

PILOT  # 

COMMENTS 

(24) 

Depends  on  command,  terrain,  airspeed 

(40)  Stop  descent 

(46)  None 


D-76 


TURN 


50.  Would  a  voice  command  be  desirable  for  the  ASA  function  (e.g. , 

RIGHT  WHOOP  WHOOP  TURN  RIGHT")  «* 

VERY  DESIRABLE  6%  (4)  ACCEPTABLE  23%  (14)  UNDESIRABLE  71%  (44) 


(Added  as  part  of  questionnaire  revision). 


I 

I 

i 

! 


PILOT  # 
(26) 

(27) 

(30) 

(32) 

(41) 

(49) 

(51) 

(63) 


RESPONSES 

Undesirable 

Acceptable 
Very  desirable 
Desirable 

Undesirable 

Undesirable 

Undesirable 

Undesirable 


COMMENTS 


Audio  warning  O.K.  without  command. 

To  indicate  on  collision  course 
and  check  ASA  instrumentation . 

Maybe 

But  no  whoop  whoop ! 

We  have  enough  racket  in  the  cock¬ 
pit  now.  The  simple  alarm  as 
installed  is  quite  sufficient. 

No  way! 

Too  many  tones  now.  I  still  feel 
that  ASA  audio  could  be  more  obvious. 

I  think  you  should  run  some  tests 
using  this  idea. 

Please .  Not  another  whoop ,  whoop ! 
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51.  a)  Would  you  like  to  have  a  sensitivity  control  which  could  control 
the  alarm  rate  by  controlling  the  point  at  which  an  aircraft  is 
declared  a  potential  threat? 

VERY  DESIRABLE  26%  (17)  ACCEPTABLE  37%  (23)  UNDESIRABLE  37%  (23) 
(Added  as  part  of  questionnaire  revision). 

PILOT  #  RESPONSE  COMMENTS 

(49)  Undesirable  Design  system  to  be  compatible 

and  not  just  another  piece  of 
equipment  to  be  disarmed. 

(63)  Undesirable  No!  You  have  to  have  some  standards 

to  work  from. 

(65)  Acceptable  A  function  of  closure  rate 


51.  b)  One  of  the  factors  controlling  the  point  at  which  an  aircraft  is 
declared  a  potential  threat  is  the  TIME-TO-COLLISION  (TAU). 
During  the  test  it  was  always  set  at  25  seconds,  which  values 
would  you  prefer  during  various  flight  phases? 


MINIMUM  PREFERRED  MAXIMUM 

Takeoff/Climb  _  _  _ 

Enroute  _  _  _ 

Descent/Landing  _  _  _ 


(Added  as  part  of  questionnaire  revision) . 
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Question  #5 lb  continued 


- 

PHASE  OF 

MINIMUM  TAU 

PREFERRED  TAU 

MAXIMUM 

TAU 

FLIGHT 

TAU 

TAU 

TAU 

(secs) 

(secs) 

Responses 

(secs) 

20 

4 

20 

i 

30 

8 

TAKEOFF/ 

25 

3 

25 

2 

40 

4 

CLIMB 

30 

15 

30 

23 

45 

4 

40 

1 

40 

2 

60 

4 

45 

2 

120 

1 

60 

2 

25 

4 

30 

13 

30 

3 

ENROUTE 

30 

13 

40 

1 

40 

1 

40 

2 

45 

6 

45 

2 

60 

1 

50 

1 

60 

9 

60 

8 

90 

2 

90 

1 

120 

2 

20 

4 

30 

24 

30 

7 

DESCENT/ 

25 

4 

35 

1 

40 

3 

LANDING 

30 

14 

40 

2 

45 

5 

45 

3 

60 

5 

60 

2 

120 

1 

PILOT  # 
(14) 
(30) 
(68) 


COMMENTS 

Don't  really  know  without  trying  in  simulation. 
Time  quite  satisfactory 

Enough  time  to  start  and  complete  maneuver  to  miss 
the  potential  threat. 
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52.  Do  you  feel  the  traffic  depiction  on  the  CRT  would  be  used  to  make 

minor  course,  typed,  or  attitude  changes  to  avoid  getting  a  maneuver 
command? 

YES  (I  did  it  during  the  test)  27%  (17) 

YES  (With  practice)  39%  (25) 

YES  (With  very  close  attention  to  the  display)  13%  (8) 

YES  (With  practice  and  close  attention)  17%  (11) 

NO  4%  (3) 

(Added  as  part  of  questionnaire  revision) . 

PILOT  #  RESPONSE  COMMENTS 

(52)  Yes  (during  the  test)  This  is  a  negative  feature. 

(64)  Yes  (with  practice)  Some  pilots  would  use  it  always- 

even  though  it  may  not  be  necessary 


53.  What  is  your  overall  reaction  to  having  an  ASA  system  similar  to  any 

of  the  ones  you  tested  tonight  being  installed  in  air  carrier  aircraft? 

(Added  as  part  of  questionnaire  revision) . 

PILOT  #  COMMENTS 

(11)  Yes,  when  developed  fully. 

(12)  I  believe  that  these  systems  are  workable  in  our  present 

work  environment.  They  would  add  a  safety  factor  to  every 
airplane  that  is  so  equipped.  There  is  no  operational 
change  required  to  gain  this  extra  safety.  A  small  amount 
of  crew  training  is  all  that  is  required.  This  could  be 
done  on  PC  PT  training.  Procedures  for  flight  path 
deviation  could  be  worked  out  by  ATC.  We  need  ASA  systems 
now  and  will  need  them  more  as  each  day  without  them  passes 

(13)  It  should  have  been  done  years  ago! 
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Question  #53  continued 


PILOT  # 

(14) 

(15) 

(16) 

(17) 

(18) 

(19) 


COMMENTS 


Good  -  especially  of  the  CRT  variety. 

I  think  it  would  add  an  additional  safety  function  which 
at  this  time  is  badly  needed. 

System  has  possibilities!  however,  CRT  and  others  force 
eyes  in  the  cockpit  too  much  during  avoidance  maneuvers. 

I  am  not  convinced  it  will  work  in  high  density  area. 

Has  good  potential 

IVSI  and  LED  would  work  well  and  be  acceptable.  CRT 
requires  too  much  interpretation,  and  attention  is 
diverted  from  other  duties  in  order  to  utilize  CRT. 

IVSI  and  LED  (located  in  scan  pattern  are  both  excellent. 
CRT  is  out  of  scan  pattern  especially  while  maneuvering 
for  CRT  commands .  Under  many  operating  conditions ,  as 
in  heavy  weather,  radar  plus  CRT  would  be  difficult  at 
best. 


(20) 

(21) 

(22) 


(23) 

(24) 


(25) 

(26) 


Very  good 

What  are  we  waiting  for? 

The  system  is  good  -  but  there  will  be  a  lot  of  evasive 
maneuvers  or  near  misses  given  by  an  instrument  command, 
where  before  the  ASA  system  and  with  the  "eyeball",  it 
was  a  wait-and-see  attitude. 

Yeah!  Particularly  IVSI  or  CRT. 

I  feel  the  CRT  with  greater  range  would  be  a  great  asset 
to  air  carriers  provided  it  doesn't  give  a  lot  of  false 
warnings  so  that  pilots  lose  confidence  in  its  ability 
to  determine  true  potential  hazards. 

IVSI,  because  it  is  in  normal  scan  and  could  be  adapted 
to  present  system  with  minimum  amount  of  difficulty. 

The  sooner  the  better! 
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Question  #53  continued 


PILOT  # 


COMMENTS 


(27) 

(28) 

(29) 

(30) 

(31) 

(32) 

(33) 

(34) 

(35) 

(36) 

(37) 

(39) 

(40) 

(41) 

(42) 

(43) 


I  feel  we  need  some  type  of  ASA  system  and  the  need 
grows  each  day  with  increased  traffic.  I  feel  we  still 
need  to  explore  and  perfect  a  workable  and  affordable 
product. 

We  needed  it  years  ago. 

The  sooner  the  better. 

I  would  favor  the  installation. 

My  reaction  was  very  favorable.  We  need  an  ASA  system. 

With  refinements  of  placement  of  device  and  proper 
practice  it  would  be  a  very  useful  tool.  Would  like  to 
test  system  at  different  time. 

Please  ASAP. 

Although  I  did  not  have  an  opportunity  to  use  the  IVSI, 
it  appeared  to  be  the  best  presentation. 

Would  like  the  IVSI  installed  -  simple  with  no  increase 
in  scan  pattern. 

Good  idea 

I  think  we  should  proceed  with  _ ? 

Need  something 
Good 

Yesterday  wasn't  soon  enough. 

Very  positive  to  the  CRT. 

Should  do  it!  My  coimnents  should  carry  very  little 
weight  here  because  they're  based  on  one  2  hour  session 
as  1st  officer  in  a  relatively  strange  environment  (727) . 
A  lot  of  comment  is  based  on  instructive  thoughts,  and  I 
might  change  my  mind  with  more  practice  in  the  use  of 
these  displays. 
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Question  #53  continued 
PILOT  #  COMMENTS 


(44) 

(45) 


(46) 


(47) 

(48) 

(49) 

(50) 

(51) 

(52) 


(53) 

(54) 


Favorable 

The  system  would  be  acceptable  provided  all  aircraft 
are  equipped  with  transponders.  Delete  all  false  warn¬ 
ings  and  provide  a  command,  etc.,  only  when  an  emergency 
is  real.  If  I  had  to  choose  one  of  the  systems  or  part 
of  a  system,  an  information  display  rather  than  a  command 
display  would  be  desirable. 

I  believe  some  sort  of  CAS  is  mandatory.  I  would  prefer 
a  CRT  type  display  for  information  and  planning  but  a 
panel-mounted  command  instrument.  One  without  the  other? 
CRT  is  nice,  but  the  IVSI  command  is  of  questionable 
value  without  the  information  background.  If  I  had  to 
settle  for  one,  would  prefer  information  to  command! 

I  would  like  to  have  one  installed. 

Problem  of  false  alerts  could  reduce  pilot  acceptance; 
a  properly  functioning  system  would  be  welcomed.  I 
especially  like  the  CRT  display  in  full  CAS. 

Good 

Outstanding  idea!  Worth  a  try. 

Very  helpful 

I  believe  the  system  would  be  acceptable  and  consider  all 
of  the  displays  to  be  also  acceptable.  Simplicity  is 
essential  when  necessary  information  is  being  presented 
during  periods  of  high  cockpit  workload.  This  allows  the 
crew  to  accept  the  information  with  a  minimum  of  confusion. 
For  this  reason,  I  believe  the  LED  display  could  be  im¬ 
proved  if  when  necessary  for  a  positive  command  —  all 
other  information  is  absent  from  the  display  at  least 
momentary. 

Would  be  valuable  provided  it  worked  all  the  time  and  did 
not  provide  too  many  false  problems. 

I  would  like  to  see  a  system  installed  in  all  IFR  equipped 
airplanes,  both  air  carrier  and  general  aviation. 
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Question 
PILOT  # 

(55) 

(56) 

(57) 

(58) 

(59) 

(60) 

(61) 

(62) 

(63) 

(64) 

(65) 

(66) 

(67) 

(68) 


#53  continued 


COMMENTS 


An  excellent  idea.  Will  allow  the  cockpit  as  well  as 
the  ground  to  see  impending  or  possible  collisions. 

Areas  like  SFO,  SAN,  ORD,  etc.,  are  becoming  increasingly 
clogged  with  traffic;  a  voiced  warning  may  not  be 
possible  in  many  cases. 

Good  idea. 

Unfortunately ,  but  necessary  to  improve  safety  levels. 

Yes,  after  a  trial  period  and  operator  experience,  1 
feel  they  would  be  very  useful. 

Positive 

A  display  such  as  CRT  would  be  a  plus  in  air  carrier 
operations.  All  the  ASA  systems  are  good  for  confidence 
building.  If  IVSI  is  used  -  more  range  information 
should  be  provided. 

If  we  save  one  life  -  it  is  well  worth  it! 

Positive 

At  this  stage  of  the  game  with  many  recent  accidents, 
the  question  should  answer  itself. 

Great 


O.K. 


Can't  happen  soon  enough. 

Airborne  presentation  sorely  needed  to  back-up  system. 
Very  favorable 
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Question  #53  continued 


PILOT  # 
(69) 


(70) 


(71) 


COMMENTS 


I  have  both  practical  and  philosophical  problems  with 
the  ASA  system. 


Practical : 


1)  Too  much  head  down  in  the  cockpit. 

There's  enough  of  that  already. 

2)  Please  not  another  ground  proximity  system! 

3)  Pilots  will  second  guess  it  unless  the 
computer  program  is  airtight! 


Philosophical:  I  suppose  more  and  more  regulations  are 

inevitable  -  but  a  ground-based  ASA  system 
(even  though  "best")  will  provide  justi¬ 
fication  for  even  bigger  PAA  beaurocracy! 

Do  we  really  want  this.  Does  the  San  Diego 
tragedy  really  justify  all  this? 


Any  help  we  can  get  would  be  a  benefit,  but  crews  should 
not  become  too  reliant  on  these  systems  and  not  continue 
visual  avoidance  too.  I  liked  them  all  and  feel  I  could 
learn  to  use  any  of  the  systems.  Reliability  is  essential  - 
proper  maintenance  is  also  very  important.  MEL  (minimum 
equipment)  for  dispatch  would  also  be  required  (i.e-, 
would  we  need  the  equipment  to  leave  small  non-maintenance 
stations)  . 


I  believe  it  is  desirable  and  inevitable. 


(72)  Any  one  of  the  three  would  be  a  much  needed  safeguard 
which  I  would  welcome,  but  my  preference  would  be  the 
CRT  and  IVSI  or  if  not  that  the  CRT  in  its  present  form 
but  not  the  IVSI  by  itself  because  we  do  need  to  know  the 
position  information  to  have  confidence  in  the  box. 

(73)  I  would  welcome  installation  ASAP. 


(74)  I  would  like  to  see  one  of  these  units  installed 

especially  the  CRT  incorporated  with  the  weather  radar. 
Our  cockpits  are  already  clogged  with  boxes. 
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APPENDIX  E 


SUPPLEMENTAL  QUESTIONNAIRE 


A  supplemental  questionnaire  was  mailed  to  each  of  the  pilots  who  par¬ 
ticipated  in  the  ASA  cockpit  evaluation  approximately  2.5  months  after  the 
close  of  testing.  The  purpose  of  the  questionnaire  was  to  help  clarify 
responses  from  the  original  questionnaire  and  to  solicit  additional  comments. 
Of  the  74  questionnaires  mailed,  50  completed  forms  were  returned. 

Questions  are  presented  in  the  appendix  exactly  as  they  appeared  in 
the  questionnaire  and  are  followed  by  the  tabulated  results.  All  comments 
are  presented  at  the  end  of  the  appendix.  Minor  editorial  changes  have  been 
made  to  improve  readability.  Results  for  questions  1  and  2  are  not  signifi¬ 
cant  in  themselves  and  are  not  presented.  The  responses  were  solicited  for 
use  in  the  data  analysis. 


AIRCRAFT  SEPARATION  ASSURANCE 
COCKPIT  EVALUATION 


FOLLOW-UP  QUESTIONNAIRE 


1.  To  the  best  of  your  recollection,  which  seat  did  you  occupy  during  the 
evaluation  of  the: 

Captain  1st  Officer  2nd  Officer  Don't  Recall 

IVSI:  _  _  _  _ 

LED:  _  _  _  _ 

CRT:  _  _ _ _ 


2.  Were  you  flying  the  simulator  during  the  evaluation  of  the: 

YES  NO  Don't  Recall 

IVSI:  _  _  _ 

LED:  _  _  _ 

CRT:  _  _ 


3.  Do  you  feel  that  traffic  advisories  are  an  essential  part  of  a  BCAS 
display? 


YES  79%  (37)  NO  21%  (10) 


4.  If  the  traffic  advisories  contain  only  altitude  and  range  of  the  surrounding 
traffic  (a  limitation  of  active  BCAS) ,  would  they  still  be  considered  an 
essential  part  of  a  BCAS  display? 

YES  76%  (35)  NO  24%  (ID 
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5.  How  would  you  describe  your  overall  wo  1 oad  during  simulation  as 
compared  to  any  other  typical  simulator  training  session? 


Unacceptable 
Increase  in 
Workload 


Acceptable 
Increase  in 
Workload 


No 

Effect  on 
Workland 


Small 
Decrease 
in  Workload 


Large 
Decrease 
in  Workload 


IVSI: 

2%  (1) 

64%  (30) 

30%  (14) 

4%  (2) 

0 

LED: 

26%  (13) 

54%  (27) 

16%  (8)' 

2%  (1) 

2%  (1) 

CRT: 

31%  (15) 

59%  (28) 

8%  (4) 

2%  (1) 

0 

6.  Active  BCAS  provides  positive  commands  (CLIMB,  DESCEND),  Negative  Commands 
(DON'T  CLIMB,  DON'T  DESCEND)  and  Limit  Commands  (LIMIT  CLIMB  2000  FPM, 
LIMIT  CLIMB  1000  FPM,  LIMIT  CLIMB  500  FPM,  LIMIT  DESCENT  2000  FPM,  LIMIT 
DESCENT  1000  FPM,  and  LIMIT  DESCENT  500  FPM).  Are  all  these  commands 
necessary? 

YES  NO 


Positive  Commands  96%  (47) 
Negative  Commands  77%  (37) 
Limit  Commands  60%  (29) 


4%  (2) 
23%  (11) 
40%  (19) 


7a.  How  would  you  rank  the  three  displays  for  active  BCAS?  (The  IVSI  and  LED 
displays  would  be  as  presented  during  the  simulation;  the  CRT,  in  a 
strictly  active  BCAS  environment  would  contain  a  graphical  representation 
of  relative  range  and  altitude;  no  bearing  information  would  be  available. 
Rank  each  display  as  first,  second,  or  third  choice. 

1-33%  (16)  1-20%  (10)  1-47%  (23) 

IVSI  _  2-31%  (15)  LED  _  2-51%  (25)  CRT  _  2-18%  (9) 

3-37%  (18)  3-29%  (14)  3-34%  (17) 


b.  Would  your  second  choice  be  acceptable  if  the  first  choice  was  not 
available? 


YES  94%  (47)  NO  6%  (3) 


c.  would  your  third  choice  be  acceptable  if  the  first  and  second  choices  were 
not  available? 

YES  52%  (26)  NO  48%  (24) 


8.  Would  you  like  to  receive  a  copy  of  the  simulation  study  final  report? 
YES  100%  (50)  NO  Q 
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Do  you  hcve  any  additional  comments  on  the  ASA  program? 

Where  possible,  aircraft  separation  information  should  be  three 
dimensional . 

Well  thought  out  program.  A  new  system  is  needed  to  be  sure. 

The  sooner  it  can  be  put  to  use  -  the  better.  The  aural  alert  should 
be  included,  although  confusing,  perhaps,  when  first  used.  As  soon  as 
flight  crews  become  used  to  an  aural  signal,  it  becomes  an  accepted 
and  useful  tool. 

First  preference  is  for  CRT  with  range  and  relative  bearing. 

Given  the  test  situation,  a  combination  of  the  "IVSI"  and  "CRT"  would 
seem  most  beneficial: 

The  "IVSI"  gives  necessary  DO  IT  NOW  information  in  simply 
perceived  form. 

The  "CRT"  adds  the  capability  for  limited  "TOTAL"  situation 
analysis  from  within  the  cockpit. 
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I  was  extremely  impressed  with  the  CRT  equipment's  ability  to  provide  a 
unambiguous  display  of  the  traffic  situation.  This  was  especially  true 
where  the  relative  bearing  information  was  available.  Where  bearing  infor¬ 
mation  is  not  available,  the  CRT  and  LED  displays  were  roughly  equivalent. 

The  IVSI  display,  I  found  to  be  extremely  difficult  to  decipher.  Granted, 
one  has  only  to  follow  specific  commands  to  avoid  the  conflict.  However, 

I  feel  that  this  runs  counter  to  any  human  instinct;  i.e.,  to  attempt  to 
visualize  the  situation  in  one's  own  mind  before  acting.  A  system  such 
as  this  would  be  viewed  as  another  way  to  removing  the  pilot  from  the 
control  loop. 

1.  I  was  flying  an  approach  using  the  LED  display.  1  had  difficulty 
flying  the  approach  while  trying  to  follow  the  evasive  action  called  for. 
Later  on  at  the  debriefing,  I  found  we  were  making  a  parallel  ILS  approach 
with  another  aircraft. 

2.  Even  though  the  briefing  was  quite  adequate  on  the  operational  aspects, 

I  feel  that  the  crew  would  have  to  spend  a  period  of  time  in  VFR  conditions 
until  they  feel  comfortable  in  most  of  the  more  common  closing  situation. 

Some  problems  also  exist  in  high  density  traffic  areas  with  heavy  radio 
traffic.  I  would  be  very  reluctant  to  deviate  from  an  assigned  heading  or 
altitude  knowing  I  probably  had  other  traffic  around. 

3.  All  things  considered,  I  feel  any  reliable  system  would  be  helpful  and 
the  systems  we  worked  with  have  great  potential  to  prevent  collisions  after 
the  crew  has  the  experience  to  quickly  assimilate  the  important  information. 

The  LED  &  IVSI  are  both  excellent  displays  of  vital  information.  A  pilot 
can  see  and  react  as  easily  as  one  reacts  to  a  glide  slope,  localizer  or 
airspeed  indicator.  The  CRT  is  unacceptable.  It  requires  excessive 
heads  down  time  to  read  and  react. 

A  type  of  HUD  display  would  help. 

A  flight  test  program  putting  an  active  BCAS  in  selective  air  carrier  air¬ 
craft  would  seem  a  better  idea  than  letting  the  FAA  flight  test  the  equipment. 
Airline  pilots  will  ultimately  be  the  main  users  of  the  BCAS  and  therefore 
their  evaluation  of  the  system  would  be  more  valid  than  the  FAA's. 

Excellent  program.  Need  more  like  it. 

I  believe  this  program  should  have  been  implemented  at  least  four  years  ago. 

We  would  have  a  viable  system  today.  Let  us  hope  no  impediments  prevent 
institution  of  the  BCAS  as  soon  as  possible. 
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Traffic  advisories  are  important,  especially  at  night.  A  target  spotted 
visually  might  appear  to  be  in  conflict  when  in  effect  it  is  not.  The 
IVSI  is  the  easiest  to  fly  but  gives  no  information  as  to  location  of 
targets.  Panel  location  of  the  LED  display  was  unacceptable  and  mental 
gymnastics  were  required  to-read-translate-and  look  for  the  targets.  CRT 
display  was  a  little  better,  as  far  as  location  is  concerned,  but  the  same 
mental  computations  were  required.  Its  location  allowed  the  second  officer 
to  participate  and  accept  part  of  the  workload.  Positive  commands  are 
necessary.  Negative  limit  commands  are  convenience  commands.  Negative  and 
limit  commands  always  make  me  wonder  how  close  I’ll  come  to  the  target  if 
I  follow  the  commands  and  never  spot  it  visually.  The  latter  two  displays 
caused  me  to  have  fixation  on  the  display  and  forget  about  the  flight 
instruments.  After  much  thought,  I  now  agree  that  vertical  correction  is 
the  most  rapid  and  effective  means  of  collision  avoidance. 

With  a  CRT  display  having  relative  range  and  altitude  representation,  I 
believe  the  pilot  could  determine  his  own  climb  or  descent  rate  thereby 
eliminating  the  need  for  limit  commands.  IVSI  and  LED  displays  would  need 
limit  commands.  Altitude  and  range  advisories  would  help  determine  the 
proximity  of  the  traffic  and  give  early  alert  as  to  the  necessity  for 
evasive  action. 

The  problem  with  the  CRT  was  the  inability  to  see  it  as  well  as  compared 
with  the  LED.  Secondly,  the  LED  data  assimilation  (ability  to  see  and 
correlate  mentally  the  information  in  order  to  integrate  that  data  into 
the  total  mencal  picture)  seemed  easier.  Because  I  was  not  that  familiar 
with  the  aircraft,  this  assimilation  made  it  all  the  more  difficult.  It 
would  be  interesting  to  test  the  data  in  my  own  aircraft. 

The  IVSI  display  was  the  most  satisfactory  for  me  with  only  a  slight  increase 
in  workload  and  at  times  no  additional  increase.  The  other  two  systems  re¬ 
quired  too  much  interpretation  by  the  pilot  to  be  useful  without  detracting 
markedly  from  other  piloting  functions. 


1.  The  potential  for  CRT  traffic  display  in  new  aircraft  (767/757)  employing 
an  electronic  HSI  or  map  presentations  is  good. 

2.  As  implemented  in  the  simulation,  the  CRT  is  poor  (location  and  lack  of 
relative  heading/track  information) . 

The  program  does  tend  to  make  you  concentrate  your  attention  inside  the  cockpit 
and  I  believe  you  should  be  looking  outside  in  this  situation. 

There  has  been  a  lot  of  discussion  about  the  BCAS  and  all  collision  avoidance 
since  I  was  able  to  fly  the  test,  a  lot  of  good  ideas  brought  up.  I  am  sorry 
I  can't  remember  them  all.  But  one  idea  is,  or  question  is,  has  any  of  the 
radar  manufacturers  worked  with  the  idea  of  a  CRT/Radar/BCAS  combined.  This 
would  lower  cost  and  also  save  space. 


I  would  like  to  be  able  to  fly  the  system  again  since  I  have  been  able  to 
think  about  it.  I  do  hope  that  this  program  is  continued,  as  I  feel  that 
it  is  of  utmost  importance  and  although  I  do  prefer  the  CRT,  any  of  the 
systems  would,  if  installed  and  crews  properly  trained,  would  be  an  asset 
to  the  safety  of  airline  travel. 


Keep  it  simple.  IVSI  displays  appeared  the  simplest  to  me. 

X  believe  it  is  important  to  separate  separation  assurance  from  collision 
avoidance.  Collision  avoidance  must  constitute  just  the  simplest  and 
least  confusing  commands. 

A  real  necessity  in  the  cockpit!  One  of  these  systems  should  become  a 
reality  of  airline  flying.  This  combined  with  ATC  reports  should  eliminate 
a  substantial  portion  of  the  near  hits  encountered  (known  or  unknown)  each 
day. 

I  felt  most  comfortable  with  the  CRT.  It  gives  a  graphic  presentation  at 
a  glance  with  minimum  interpretation  necessary;  this  is  essential  since 
the  unit  will  be  most  used  when  cockpit  work  loads  are  highest,  i.e., 
approach,  landing,  and  departure  phase. 

Enjoyed  the  testing  and  the  professional  attitude  of  the  test  crew. 

I  feel  that  the  LED  display  is  okay  in  straight  and  level  flight  but  can 
be  very  confusing  during  a  turn. 

Press  on. 

When  you  remove  bearing  from  the  CRT,  you  greatly  degrade  its  usefulness. 

Any  other  aircraft  that  maintains  a  constant  relative  bearing  on  the  wind¬ 
shield  and  continually  gets  larger  in  size  (decreasing  ranqe)  is  a  theoretical 
midair.  I  tend  to  evaluate  constant  bearing,  decreasing  range  before  altitude, 
since  the  other  aircraft  may  be  climbing  towards  me  or  descending  towards  me. 

To  the  unaided  (and  non-computerized)  human  eye,  constant  bearing,  decreasing 
range  is  a  vital  key  to  evaluating  a  midair  threat. 

The  best  combination  of  all  would  be  CRT  for  information  with  IVSI  for 
commands . 

I  felt  this  simulator  test  was  authentically  presented  (ATC  environment) 
and  professionally  administered. 
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DATA  ANALYSIS  FORMULAS 


This  appendix  provides  a  detailed  description  of  the  statistical 
tests  that  were  used  in  the  quantitative  data  analysis.  A  short  glossary 
of  the  statistical  terminology  used  is  included  at  the  end  of  this 
discussion. 

The  first  three  tests  are  distribution-free  statistical  tests  that 
have  been  applied  to  the  response  time  data. 

I.  Kruskal-Wallis  One-Way  Analysis  of  Variance  by  Ranks 

This  test  is  a  difference  in  location  test.  It  compares  distributions 
of  response  times  by  several  treatments  to  determine  treatment  effects. 
Significant  differences  between  distributions  are  noted. 

II.  Kolmogorov-Smirnov  Two-Sample  Test 

This  test  is  a  comparison  test  between  two  sample  distributions.  The 
cumulative  probability  distributions  of  the  two  samples  are  compared  for 
significant  differences.  The  following  statistical  tests  were  performed 
(based  on  the  normal  distribution)  on  pitch  rate  and  roll  angle  data  since 
their  measurements  are  continuous  and  follow  normal  distributions  more 
closely. 

III.  Analysis  of  Variance  (ANOVA) 

A.  One-way  classification.  This  method  determines  the  differences 
caused  by  a  single  influencing  factor  among  several  sets  of 
measurements. 

B.  Two-factor  experiment.  This  method  determines  the  differences 
caused  by  two  influencing  factors  among  several  sets  of  measure¬ 
ments.  These  two  tests  were  used  in  the  analysis  of  response 
magnitude  measurement. 

IV.  Significance  of  Difference  Between  Variances  (F-Test) 

This  aids  in  determining  whether  the  variances  of  two  sample  sets 
are  equal.  The  direction  of  difference  may  also  be  tested. 


V.  Significance  of  Difference  Between  Means  (t-Test) 

This  test  aids  in  determining  whether  the  means  of  two  sample 
are  equal.  The  direction  of  difference  may  also  be  tested. 
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I.  Kruskal-Wallis  One-Way  Analysis  of  Variance  by  Ranks* 
k 

Data:  N  =  X  n.  observations 

-  j=l  3 

n.  observations  from  the  j  treatment,  j 

: 

treatments 


1 

2  . 

.  .  .  .  k 

x,  , 

y 

....  X 
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lk 

x  . 

X  . 

....  X 
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2k 

- 

- 

• 

• 

• 

• 

• 

• 

* 

- 

Xn,2 

• 

2 

X  ! 
V 

Xn  k 
k 

Hypotheses : 

Null  —  H„:  T..  =  .  .  .  =  T.  T.  is  the  treatment  effect 

0  1  k  3 

Alternate  —  H,  :  T.'s  are  not  equal 
1  3 

Procedure : 

1.  Rank  all  N  observations  jointly,  from  least  to  greatest.  Let  r 
denote  the  rank  of  X  ^  in  this  joint  ranking. 

2.  Set  ,  for  j=l,  ...»  k 

n . 

R.  =  X  r. .  r  .  =  R  =  N+i 


3  i=l  13 


*3  "j 


♦Hollander,  M.  and  Wolfe,  D.A.,  Non-Parametric  Statistical  Methods;  John 
Wiley  and  Sons,  Inc.,  1973;  pp  114-116. 


3 .  Compute 


II. 


H  = 


N  (N+l )  (R*j  ~  R**) 

-  - 

1  -  L  T./[N  -N] 


j  =  l  J 

where  g  =  number  of  tied  groups 

T 3  =  (tj3  -  V 

t^  =  size  of  tied  group  j. 

2 

4.  When  Hq  is  true,  the  statistic  H  has  an  asymptomatic  x  distribution 
based  on  k-1  degrees  of  freedom.  The  approximate  a-level  test  is: 

reject  Hfl  if  H  >  X2(k_li0t) 

accept  Hq  if  H  <  X2(k_ljCt) 

5.  Note:  For  ties  use  average  ranks. 


Kolmogorov-Smirnov  Two-Sample  Test* 

Data:  Two  independent  samples  of  data  with  number  of  samples  n  in 
sample  1,  and  n 2  in  sample  2. 

Procedure : 

Hq:  the  two  samples  have  been  drawn  from  the  same  population. 

H^:  the  two  samples  have  not  been  drawn  from  the  same  population. 

1.  For  each  observed  value  X,  compute  the  observed  cumulative  step 
functions  for  samples  1  and  2. 

Let  S  (X)  =  K/n  ,  where  K  =  the  number  of  measurements  equal  to 
ni  1 

or  less  than  X,  and  let  S  (X)  =  K/n_ ,  where  K  =  the  number  of 

n2  2 

measurements  equal  to  or  less  than  X. 


*Seigel ,  Sidney,  Non-Parametric  Statistics;  McGraw-Hill,  Inc.,  1956; 
pp  127-136,  279. 


2.  The  Kolmogorov-Smirnov  two-sample  test  focuses  on 


D  =  maximum  Is  (X)  -  S  (X) I 
ni  n2 

3.  For  n^,  n^  >  40  (not  necessary  for  n^  =  n^)  the  following  table 
is  used  to  determine  whether  or  not  to  reject  HQ: 


TABLE  OF  CRITICAL  VALUES  OF  D  IN  THE 

KOLMOGOROV-SMIRNOV  TWO- SAMPLE  TEST 

Value  of  D  so  large  to  call  for 

Level  of 

rejection  of  at  the  indicated 

Significance 

level  of  signif icance  where 

D  =  maximum  |s  (X)  -  S  (X) 1 
nj  n  2 

.10 

1.22  \/ni  +  n2 

V  nm2 

.05 

1.36  \/ni  +  02 

V  nm2 

.025 

1.48  \/ni  +  n2 

V  nm2 

.01 

1.63  \/ni  +  112 

V  nm2 

.005 

1.73  \/ni  +  nz 

V  n  i  n2 

.001 

1.95  \/ni  +  112 

V  n  i  n2 

4.  When  n1>n2  <  40  (not  necessary  for  n^  =  n^) ,  compute  the  chi- 
squared  statistic 

2  2  nln2 

y  =  4D  -  with  2  degrees  of  freedom 

ni  +  n2 

Reject  in  favor  of  if  at  the  a  level  of  significance 
X2  >  X2  (2, a) 
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Analysis  of  Variance  (ANOVA) * 


A.  One-way  classification 
Data : 


j  MEASUREMENTS  ] 

Treatment 

1 

xu 

X12  *  •  • 

*  •  Xlb 

Treatment 

2 

X21 

X22 

•  '  X2b 

Treatment 

a 

Xal 

Xa2  *  *  * 

•  *  Xab 

Treatment  mean :  X .  =  —  £  X . , 

-  3.  b  k=i  Dk 


j  1#  2  f  ...  f  ci 


Overall  mean: 


-  i  a  b 

x  =  l  I  X 

ab  .  .  ,  ,  3k 

j=l  k=l  J 


Variation:  V  =  V  +  V, 

-  w  b 

V  is  the  total  variation 

V  is  the  variation  within  treatments 
w 

V  is  the  variation  between  treatments 
b 


'Spiegel,  Murray  R. ,  Probability  and  Statistics;  McGraw-Hill,  Inc 
pp  306-313. 


Analysis  of  Variance  Table: 


Variation 

Degrees  of 
Freedom 

Mean  Square 

F 

Between  treatments 

V  =  bZ  (X .  -  X)2 

b  j 

a-1 

$  2  Vb 

Sb  “  a-1 

h* 

s  2 

W 

with  a-1, 
a(b-l)  degrees 
of  freedom 

Within  treatment 

V  =  V  -  V, 
w  b 

a(b-l) 

v 

£  2  w 

w  "  a(b-l) 

Total 

V  =  V,_  +  V 
b  w 

=  2  <x.k  -  X)2 

ab-1 

To  test: 


H0: 

=  y 

j  —  1/  •  •  •  r  3. 

H1S  ^ 

¥  y 

j  =  1  ,  • • • 9  ^ 

where  y  ^  is  the  actual  population  mean  for  treatment  j  and  y  is  the  overall 
population  mean. 

Hq  is  the  hypothesis  that  the  treatment  means  are  all  equal,  is 

the  alternate  hypothesis  that  the  treatment  means  are  not  all  equal. 

S  2 

2 

— —  is  X  distributed  with  a-1,  a(b-l)  degrees  of  freedom. 

S  2 
w 


Accept  Hq  if 


—  <  F 

2  -  l-a 


Reject  Hq  if  — — 

u  s 

w 


>  F 


l-a 


at  the  a  level  of  significance. 
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Modification  for  unequal  numbers  of  observations: 


Let  n .  be  the  number  of  measurements  from  treatment  j . 

3 

a 

£  n .  =  n  total  number  of  measurements 

j-1  3 

The  following  analysis  of  variance  table  shows  the  computation  of 
variations : 


Mean 

Square 


Variation 

Degrees  of 
Freedom 

Between  Treatments 

V  =  £  n  .  (X .  -  X)  2 

b  in* 

3 

a-1 

With  Treatments 

V  =  V  -  V 
w  b 

n-a 

Total 

V  =  V  +  V 
b  w 

n-1 

=  .Zk(Xik-")2 

B.  Two-factor  experiments 
Data: 


Treatments 


Blocks 


2  2  b  ~  2 

S  =  — —  S 

b  a-1  b 


with  a-1,  n-a 


S  degrees  of 
freedom 


0  V 
;  2  _  w 

w  n-a 


1  x  , 

X 

X,, 

11 

12 

lb 

2  X 

X 

X 

21 

22 

2b 

a  X  , 

X 

X  , 

al 

a2 

ab 

X  , 

X  „ 

x 

•1 

•2 

•b 

Wtw  w. 


H  All  treatment  means  are  equal 

(2) 

Hq  :  All  block  means  are  equal 


IV.  Significance  of  Difference  Between  Variances  (F-Test)* 

The  F-test  is  a  test  of  significance  between  two  sample  variances 
2  2 

S  ,  S  of  data  sets  X  and  Y  assumed  to  come  from  the  same  population  with 

x  y  2  2 

actual  variances  0  =0 

x  y 


Sample  variance: 
Procedure : 


-(£) 


N 

l  X." 
i=l  1 


N 


£  X. 

1  i=l 


1.  Compute  the  F-ratio: 


F  = 


2  2  2  2 

S  /S  if  S  >  S 

x  y  x  y 

2  2  2  2 

S  /S  if  S  <  S 

y  x  x  -  y 

Let  m^  and  ir>2  be  the  number  of  samples  used  in  computing  the  variance 
in  the  numerator  and  denominator,  respectively. 

2.  To  test  for  significance  of  variance: 

H„ 


0 


2  2 
0  =0 
x  y 


H. 


2  2 
0  t  a 
x  y 


Hq  is  the  hypothesis  that  the  variances  for  X  and  Y  are  equal; 

is  the  alternate  hypothesis  that  the  variances  for  X  and  Y  are  unequal. 

3.  Since  F  has  F  distribution  with  M  -  1,  -  1  degrees  of  freedom, 

test  at  the  a  level  of  significance: 

Accept  Hq  if  Fa  <  F  <  F  a;  Reject  HQ  otherwise 
2  1~2 


*Hoel,  Paul  G. ,  Introduction  to  Mathematical  Statistics;  John  Wiley  and 
Sons,  Inc.,  1971;  pp  271-273. 


V.  Significance  of  Difference  Between  Means  (t-Test)* 


_  The  t-test  is  a  test  of  significance  between  two  sample  means  X  and 
Y  of  data  sets  X  and  Y  assumed  to  come  from  the  same  population. 


—  l 

Sample  mean:  X  =  —  £  X. 

-  „  ,=i  x 


Let  and  be  the  number  of  samples  used  in  computing  the  variance 
in  the  numerator  and  denominator,  respectively. 


Procedure : 


2  2 

1.  If  a  J-  o  ,  then  compute  the  t-test  statistic  and  degrees  of 
x  y 

freedom  given  by: 


2  2 
2.  If  a  -a  , 
x  y 

freedom  given  by: 


then  compute  the  t-test  statistic  and  degrees  of 


V  =  -  2  degrees  of  freedom 

*Hoel,  Paul  G. ,  Introduction  to  Mathematical  Statistics;  John  Wiley  and 
Sons,  Inc.,  1971;  pp  262-265. 
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3.  The  significance  test  for  the  mean  is  based  on  the  following 
hypothesis : 


Hq:  X  =  Y 

H1=  X  f  Y 

Hq  is  the  hypothesis  that  the  means  for  sample  X  and  Y  are  equal; 
is  the  alternative  hypothesis  that  the  means  for  sample  X  and  Y  are 
unequal . 

4.  Since  t  has  student's  t  distribution,  test  at  the  level  of 
significance  a: 

Accept  Hq  if:  -t  Q  <  t  <  t  Q 
1_2  1_2 


with  v  degrees  of  freedom.  Reject  Hq  otherwise. 


DEFINITIONS 


1.  Block  A  block  is  an  influencing  factor  in  an  experiment. 

Examples  of  blocks  may  be: 

•  Individual  pilots  responding  to  a  specific  question 

•  Groups  of  pilots  responding  to  a  specific  question 
in  the  same  way 

•  Different  command  types 


2.  Hypothesis  A  hypothesis  is  assumed  to  be  true  at  the  onset  of  an 

Testing  experiment.  This  hypothesis  is  noted  by  H0,  the  null 

hypothesis.  In  addition,  an  alternative  to  the  null 
hypothesis  is  proposed;  this  is  noted  by  Hj_,  the  alter¬ 
native  hypothesis.  Two  possible  outcomes  of  the 
experiment  are: 


•  Ho  is  accepted  —  the  null  hypothesis  is  accepted 
as  being  true  (i.e.,  cannot  be  rejected) 

•  Hq  is  rejected  in  favor  of  H^  —  the  first  hypothesis 
is  rejected  and  hence,  the  alternative  hypothesis 

is  accepted. 


3.  Level  of  The  level  of  significance  (a)  is  the  maximum  probability 

Significance  risk  of  a  Type  I  error,  where  the  Type  I  error  is 

(a)  defined  to  be  the  error  of  rejecting  the  null  hypo¬ 

thesis,  Hg,  when  Hg  is  actually  true. 


4.  Population  and 

Sample  Parameters 


5 .  Treatments 


The  population  parameters  are  the  actual  param¬ 
eters  of  the  underlying  population  from  which  a 
sample  is  derived.  Most  often,  values  for  these 
parameters  are  unknown.  Hence,  estimates  are 
computed  from  the  sample  set. 

A  treatment  is  a  factor  in  an  experiment  applied 
to  blocks  or  measurements.  An  example  of  a  treat¬ 
ment  is  the  effect  of  display  type  (IVSI,  LED, 

CRT)  on  pilot  response  time. 
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APPENDIX  G 


TEST  BED  DESCRIPTION  DETAILS 


This  appendix  provides  details  on  the  simulation  test  bed  that  have 
not  been  covered  in  the  body  of  the  report.  Specifically,  the  areas  covered 
are  the  software  design  details,  the  interface  between  the  computer-generated 
image  (CGI)  computer  and  the  simulation  control  computer,  and  the  display 
device  drivers. 


1.  SOFTWARE  DESIGN  DETAILS 

This  section  describes  the  software  developed  under  contract  for  the 
PDP-11/34,  which  was  used  as  the  simulation  control  computer.  The  software 
was  written  in  both  FORTRAN  and  assembly  language  under  Digital  Equipment 
Corporation's  RSX-llM  operating  system.  The  only  purchased  software  was 
a  graphics  package  purchased  from  TEKTRONIX,  Inc.  to  drive  the  graphics 
terminal  used  for  the  air  traffic  controller's  position. 

The  software  was  developed  under  RSX-llM 's  multitasking  environment 
which  allows  several  executable  modules  (called  tasks)  to  compete  simul¬ 
taneously  for  the  computer's  resources.  Tasks  can  be  executed  continuously, 
periodically,  or  on  request.  A  predetermined  priority  scheme  is  used  to 
decide  which  tasks  are  executed  at  any  point  in  time. 

The  simulation  tasks  can  be  described  in  terms  of  five  areas:  param¬ 
eter  initialization,  the  simulator  interface  service  routine,  the  main  loop, 
the  console  operator,  and  the  display  drivers.  This  section  describes  the 
first  four  areas.  The  software  description  of  the  display  drivers  is 
included  in  Section  3  since  it  is  difficult  to  separate  the  software  and 
hardware  descriptions . 

1.1  Parameter  Initialization 


A  separate  task  was  executed  at  the  beginning  of  each  simulated  flight 
to  initialize  the  simulation  parameters  which  were  stored  in  a  shared  data 
region.  The  simulation  parameters  are  categorized  as  follows: 

•  Collision  Avoidance  System  Parameters  -  These  are  the  values  used 
by  the  tracking,  detection,  resolution,  and  proximity  warning  indi¬ 
cation  (PWI )  logic  to  determine  if  a  conflict  situation  exists. 

(See  Table  G-l  for  values.) 
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Table  G-l.  COLLISION  AVOIDANCE  SYSTEM  PARAMETERS 

Name 

Description 

Value 

ALFAR 

Tracking  constant  for  range  (Active  mode 

only ) 

0.4 

ALFAX 

Tracking  constant  for  X  and  Y  position 
(Full  mode  only) 

0.4 

ALFAZ 

Tracking  constant  for  altitude 

0.4 

ALIM 

Vertical  miss  distance  threshold  used  in 
command  selection 

400  Feet 

ASEPV 

> 

Vertical  miss  distance  threshold  used  in 
horizontal  versus  vertical  selection  logic 
(Full  mode  only) 

350  Feet 

BETAR 

Tracking  constant  for  range  rate  (Active 

mode  only) 

0.15 

BETAX 

Tracking  constant  for  X  and  Y  velocity 
(Full  mode  only) 

0.15 

BETAZ 

Tracking  constant  for  altitude  rate 

0.15 

DMOD* 

Distance  modification  of  tau  threshold  for 
collision  avoidance  logic 

1.0  nmi 

0.5  nmi 

0 . 3  nmi 

DMODP  * 

Distance  modification  of  tau  threshold  for 

PWI  detection  logic  (Full  mode  only) 

1 . 0  nmi 

0 . 5  nmi 

0.3  nmi 

MDCMD* 

Square  of  horizontal  miss  distance  threshold 
beyond  which  no  commands  are  requested 
(Full  mode  only) 

9.0  nmi 2 

4.0  nm i 2 

1 . 0  nmi 2 

MDPOS* 

Square  of  horizontal  miss  distance  threshold 
used  for  positive  versus  negative  command 
selection  (Full  mode  only) 

1 .0  nmi 2 

0.25  nmi 2 

0.25  nmi 2 

RDESEN 

Range  threshold  used  to  desensitize  colli¬ 
sion  avoidance  logic  at  low  altitude 

15.0  nmi 

RDTHR 

Range  rate  threshold  used  to  choose  between 
tau  test  and  immediate  range  test 

10. 0  FPS 

ROFF 

Range  threshold  used  to  shut  off  collision 
avoidance  logic 

2.0  nmi 

RTHPO* 

Immediate  range  threshold  for  PWI  logic 

3 . 0  nmi 

2.0  nmi 

1 . 0  nmi 

RTHR 

Immediate  range  threshold  for  collision 
avoidance  logic 

0.1  nmi 

♦Desensitized  parameters 


Table  G-l .  (continued) 


Name 

Description 

Value 

RZIPDO 

Altitude  separation  threshold  for  PWI  logic 

2,000  Feet 
1,500  Feet 
1,000  Feet 

TIMETX 

Time  to  track  crossing  point  threshold  (Full 
mode  only) 

10  seconds 

TIPDO 

Tau  threshold  for  PWI  loqic 

60  seconds 

TLARGE 

Default  tau  value 

100,000 

seconds 

TMIN 

Minimum  time  that  a  command  is  displayed 
before  being  'changed 

5  seconds 

TRTHR* 

Modified  tau  threshold 

30  seconds 

25  seconds 

25  seconds 

TVPCMD* 

Look-ahead  time  used  to  compute  the  pro¬ 
jected  vertical  miss  distance 

25  seconds 

20  seconds 

20  seconds 

TVTHR* 

Vertical  tau  threshold 

30  seconds 

25  seconds 

25  seconds 

TVl 

Look-ahead  time  used  for  vertical  commands. 

8  seconds 

TV2 

Used  in  conjunction  with  TVl  to  bracket  ver¬ 
tical  t  «i  in  horizontal  versus  vertical 
selection  logic  (Full  mode  only) 

16  seconds 

TXTH 

In  horizontal  resolution,  the  track  crossing 
angle  at  which  the  resolution  angle  changes 
(Full  mode  only) 

90  degrees 

VTHSQ 

Velocity  squared  threshold  used  to  charac¬ 
terize  an  aircraft  as  fast  or  slow  in  hori¬ 
zontal  versus  vertical  selection  logic  (Full 
mode  only) 

(150)2  ]<T2 

ZDESEN 

Altitude  threshold  below  which  logic  is 
desensitized 

10,000  Feet 

ZDTH2 

Vertical  rate  threshold  used  in  the  hori¬ 
zontal  versus  vertical  selection  logic 
(Full  mode  only) 

6  FPS 

ZDTHR* 

Altitude  separation  rate  threshold 
(Note:  ZDTHR  =  -ZTHR/TVTHR) 

-30  FPS 

-36  FPS 

-36  FPS 

ZTHR 

Altitude  separation  threshold 

900  Feet 

Legend : 

nmi  =  nautical  miles,  nmi2  =  nautical  miles  squared, 

FPS  =  feet  per  second,  and  KT2  =  knots  squared 

•  Maneuver  Variables  -  Up  to  12  aircraft  could  be  created  flying  as 
many  as  five  maneuvers  (changes  in  heading,  speed,  or  altitude) . 
These  variables  provided  the  information  required  to  update  each 
aircraft's  position  and  velocity. 

•  Aircraft  State  Vector  -  These  variables  represent  an  aircraft's 
state  (position,  velocity,  identification,  etc.)  at  any  point  in 
time  (both  true  and  tracked  state) . 

•  Simulator  Interface  Buffer  -  This  buffer  area  was  used  for  the 
transfer  of  simulator  parameters  (position,  velocity,  and  attitude) 
from  the  CGI  computer  to  the  simulation  control  computer  and  traffic 
position  information  from  the  simulation  control  computer  to  the 
CGI  computer. 

•  Simulation  Flags  and  State  Variables  -  These  variables  provided 
simulation  control  and  status. 

1.2  Simulator  Interface  Service  Routine 


The  interface  task  provides  the  software  interface  between  the  simula¬ 
tion  control  computer  and  the  computer-generated  image  (CGI)  computer.  The 
purpose  of  the  task  is  to  obtain  simulator  data  from  the  CGI  computer  and 
to  transfer  traffic  data  to  the  CGI  computer.  The  simulator  data  consists 
of  position  (x,  y,  z) ,  velocity  (x,  y,  z) ,  and  attitude  (pitch  rate,  roll, 
and  yaw)  of  the  cockpit  simulator.  The  traffic  data  consists  of  position 
data  (x,  y,  z)  for  as  many  as  six  pairs  of  lights  which  represent  aircraft 
in  the  computer-generated  visual  scene. 

The  data  are  transferred  through  the  UNIBUS  window  (see  Section  2) 
which  provides  the  hardware  link  between  the  two  computers .  The  hardware 
sets  up  a  window  between  the  simulation  control  computer's  memory  and  the 
CGI  computer's  memory.  The  interface  initializes  the  hardware,  performs 
the  data  transfers,  and  provides  error  handling. 

The  interface  task  executes  every  1/20  of  a  second  (corresponding  to 
the  cockpit  simulator  update  rate)  and  at  the  highest  task  priority.  At 
1  second  intervals,  the  interface  task  initiates  the  main  loop  task. 

1 . 3  Main  Loop 

The  main  loop  task  performs  most  of  the  simulation  functions.  These 
functions  include  simulation  administration,  traffic  generation,  intruder 
logic,  tracking,  conflict  detection  and  resolution,  and  data  recording. 

Simulation  administration  consists  of  file  management  (opening  appro¬ 
priate  files) ,  task  initialization  (initiating  driver  tasks  based  on  selected 
options)  and  maintaining  the  simulation  clock. 

The  traffic  generation  logic  reads  a  file  of  traffic  data,  initializes 
aircraft,  flies  these  aircraft  along  an  arbitrarily  complex  flight  path,  and 
terminates  the  aircraft  at  a  particular  time.  The  traffic  file  contains 
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start  time,  aircraft  number  (1-12),  aircraft  identification  (e.g.,  UA107) , 
initial  position  (x,  y,  z) ,  heading,  and  speed.  The  file  also  contains  data 
for  as  many  as  five  maneuvers. 

The  maneuver  data  include  the  time  at  which  the  maneuver  begins,  the 
maneuver  type  (heading,  speed,  or  altitude),  the  maneuver  goal,  and  the 
maneuver  rate.  More  than  one  maneuver  type  may  be  active  at  any  one  time. 
Maneuvers  terminate  when  the  maneuver  goal  is  achieved. 

As  many  as  11  aircraft  can  be  active  at  any  time.  Aircraft  initialized 
with  the  same  aircraft  number  as  an  active  aircraft  cause  the  termination  of 
the  active  aircraft.  Aircraft  requiring  more  than  five  maneuvers  can  be 
terminated  and  then  reinitialized  with  a  new  set  of  maneuvers  at  the  point 
of  termination. 

The  maneuvers  cause  updates  to  the  aircraft  control  variables  (heading, 
speed,  and  altitude)  which  in  turn  are  used  to  update  position  (x,  y)  and 
velocity  (x,  y)  using  a  simple  integration  scheme.  These  data  then  act  as 
input  to  the  tracker  logic. 

The  position  data  are  also  used  to  update  the  aircraft  lights  in  the 
visual  scene.  This  requires  coordinate  rotation  and  translation  into  the 
visual  system  coordinates.  The  data  are  then  stored  in  the  shared  data 
region  for  retrieval  by  the  simulator  interface  task. 

The  intruder  logic  was  responsible  for  initiating  conflicts  with  the 
cockpit  simulator.  Intruder  data  were  stored  in  a  separate  file  and  included 
information  on  the  intruder's  initial  position,  velocity,  and  heading  as 
well  as  any  applicable  maneuvers. 

There  were  two  types  of  conflicts:  those  controlled  by  the  simulation 
computer  and  those  controlled  by  the  air  traffic  controller.  The  computer- 
controlled  conflicts  initialized  the  intruder  based  on  the  simulator's 
current  position,  and  adjusted  speed  and  altitude  to  ensure  a  conflict. 

Those  controlled  by  the  air  traffic  controller  were  initialized  at  a  specific 
point  in  space,  and  it  was  the  responsibility  of  the  controller  to  ensure  the 
conflict  by  issuing  appropriate  clearances  to  the  pilot  in  the  cockpit  simu¬ 
lator.  This  type  of  control  was  used  primarily  for  conflicts  in  which  one 
or  both  aircraft  were  turning. 

Intruders  were  initiated  in  two  stages.  First,  they  were  released 
manually  by  the  simulation  controller  (see  Subsection  1.4).  This  allowed 
additional  control  over  the  conflict.  A  conflict  was  not  initialized  until 
the  simulation  controller  and  air  traffic  controller  were  satisfied  that 
the  simulator  pilot  was  established  on  course.  Once  released,  the  intruder 
did  not  start  flying  until  the  simulator  reached  an  established  point  in  his 
flight  path.  If  he  was  already  past  that  point,  the  intruder  began  imme¬ 
diately.  Once  started,  the  intruder  was  treated  internally  as  any  other 
aircraft  with  one  exception.  The  simulation  controller  could  modify  the 
intruder's  speed  and  altitude  on  request  (see  Subsection  1.4)  to  help  ensure 
a  conflict  situation.  Intruders  were  terminated  by  request  or  when  another 
intruder  was  initialized. 
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The  tracker  is  a  simple  alpha/beta  tracker  which  operates  on  the  posi¬ 
tion  and  velocity  data  provided  by  the  traffic  generator.  The  tracker 
operates  in  both  active  and  full  mode.  In  active  mode,  the  tracker  is 
executed  once  per  second  updating  range  and  altitude  only.  The  full  mode 
tracker  executes  once  every  4  seconds  and  updates  position  (x,  y,  z)  and 
velocity  (x,  y,  z)  . 

The  collision  avoidance  software  consists  of  a  detection,  resolution, 
and  proximity  warning  indication  (PWI)  logic  for  both  active  and  full  mode. 
The  logic  was  executed  once  per  second  in  active  mode  and  once  every  4 
seconds  in  full  mode.  The  logic  considers  all  pairs  of  aircraft  which  include 
the  cockpit  simulator.  The  output  of  the  logic  are  traffic  advisories  and 
collision  avoidance  commands  which  are  used  by  the  display  driver  software. 
(See  Subsection  1.5.)  The  collision  avoidance  logic  was  furnished  by  the 
FAA  and  is  referenced  in  Chapter  One,  Section  1.1. 

The  data  recording  software  saved  appropriate  data  on  disk  for  later 
transfer  to  magnetic  tape.  The  data  were  written  in  binary  form  for  effi¬ 
ciency  and  converted  to  readable  form  offline.  The  data  included  simulator 
position,  velocity,  and  attitude,  command  data  (time,  command  type,  aircraft 
number),  intruder  data  (time  and  initial  position,  heading,  and  speed), 
and  simulation  controller  interaction  (Subsection  1.4) .  All  other  data 
were  reproducible  offline. 

1.4  Console  Operator  Task 

This  task  was  initiated  by  the  simulation  controller  to  obtain  data 
about  the  simulation  and  to  interact  with  the  simulation.  The  interaction 
was  accomplished  by  modifying  flags  which  were  part  of  the  shared  data 
region.  The  task  was  low  priority  and  executed  when  time  was  available. 

The  simulation  controller  could  obtain  information  about  any  or  all 
of  the  aircraft  actively  flying  in  the  simulation.  This  data  included 
simulation  time,  aircraft  number,  aircraft  identification,  position  (x,  y, 
z) ,  heading,  and  speed. 

The  control  that  the  simulation  controller  could  exercise  was  as 
follows : 


•  Kill  -  the  controller  could  terminate  any  of  the  aircraft  other 
than  the  simulator 

•  Over  -  this  command  terminated  the  entire  simulation  and  performed 
the  necessary  cleanup 

•  Pause  -  the  controller  could  suspend  the  simulation  at  any  time 
(only  applicable  during  debug) 

•  Resume  -  the  controller  could  resume  the  simulation  if  suspended 

•  Mode  -  this  command  changed  the  collision  avoidance  mode  from  active 
to  full  or  full  to  active 

•  Display  -  this  command  selected  the  active  collision  avoidance  dis¬ 
play  (only  used  during  initialization) 
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•  Speed  -  the  controller  could  modify  the  speed  of  the  intruder  air¬ 
craft  in  increments  of  10,  20,  30,  40,  or  50  knots  at  100  knots  per 
minute 

•  Altitude  -  the  controller  could  modify  the  altitude  of  intruder  in 
increments  of  1,000,  2,000,  3,000,  4,000,  5,000  feet  at  3,000  feet 
per  minute 

•  Start  -  this  command  released  the  next  intruder 

•  Draw  -  this  command  redrew  the  air  traffic  controller's  display 
centering  the  display  at  the  cockpit  simulator's  position 

•  Simulation  Speed  -  the  controller  could  control  the  simulation 
clock  speed  (not  used  when  interfaced  to  cockpit  simulator  -  debug 
mode  only) 


2.  COMPUTER-TO-COMPUTER  INTERFACE 

The  simulation  control  computer  (PDP-11/34)  was  interfaced  to  the 
computer-generated  image  (CGI)  computer  (PDP-11/35)  through  a  Digital  Equip¬ 
ment  Corporation  UNIBUS  window*.  The  UNIBUS  window  is  a  high  speed  interbus 
channel  that  connects  two  PDP-11  systems.  The  window  allows  a  PDP-11  system 
to  access  addresses  on  a  companion  system's  UNIBUS  as  though  they  (the 
addresses)  were  on  its  own.  It  does  so  by  automatically  translating  requests 
to  a  designated  part  of  the  bus-address  space  into  requests  on  the  other  bus. 
Since  all  synchronization  is  done  internally  by  the  window  hardware,  the 
operation  is  completely  transparent  to  the  operating  software. 

The  window  can  be  from  512  to  32K  words  (16  bits)  in  size  and  is  nor¬ 
mally  placed  directly  above  the  last  memory  module  in  each  machine.  The 
window  size  selected  was  512  words  to  minimize  the  impact  on  the  existing 
CGI  display  software.  Therefore,  since  the  simulation  control  computer 
has  64K  words  of  memory,  the  window  has  placed  from  64K  (address  400000q) 
to  64  1/2K  (address  402000g) .  Once  initialized,  any  access  from  the  simu¬ 
lation  control  computer  to  a  location  between  400000g  and  402000g  would  be 
translated  automatically  into  an  access  to  a  1/2K  address  area  on  the  com¬ 
panion  system's  UNIBUS.  (This  1/2K  area  is  selected  as  part  of  window 
initialization.)  While  either  processor  was  capable  of  originating  an 
access  through  the  window,  only  the  simulation  control  computer  was  used 
for  this  purpose.  Again,  this  was  done  to  minimize  the  number  of  software 
changes  required  on  the  CGI  computer. 

Initialization  was  accomplished  by  setting  bits  in  the  UNIBUS  window's 
control  and  status  registers.  These  bits  represented  transfer  enable  and 
write  enable  flags.  In  addition,  a  relocation  address  register  was  set  to 
specify  the  1/2K  area  in  the  CGI  computer. 

Interrupt  on  error  condition  was  disabled  to  eliminate  the  need  for 
interrupt  service  routines.  Error  handling  was  accomplished  in  the  inter¬ 
face  software . 


* PDP-11  Peripherals  Handbook,  Digital  Equipment  Corporation,  1976. 
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Once  initialized,  the  data  transfers  were  very  straightforward.  To 
access  address  data  area  +  100s  on  the  CGI  computer,  the  interface  program 
requested  address  400000g  +  100g  or  4001008 •  This  request  is  translated 
by  the  UNIBUS  window  hardware  and  transformed  to  the  appropriate  address 
in  the  CGI  computer's  memory.  A  second  bus  request  is  generated,  this  time 
in  the  CGI  computer,  and  the  transfer  is  completed. 

Since  the  transfer  used  the  busses  on  both  computers  and  performed  the 
transfer  at  a  high  priority,  it  essentially  stopped  all  execution  on  the  CGI 
computer.  Therefore,  it  was  critical  to  create  an  interface  routine  that 
would  execute  very  rapidly  to  minimize  impact.  The  interface  routine  used 
was  written  in  assembly  language  with  an  execution  of  less  than  150  micro¬ 
seconds.  The  routine  was  executed  every  1/20  of  a  second  (50,000  micro¬ 
seconds)  and  resulted  in  no  noticeable  degradation  in  the  computer  generated 
visual  scene. 


3.  DISPLAY  DRIVERS 

This  section  describes  the  hardware  and  software  interfaces  to  the  three 
display  devices  used  in  the  simulation. 

3.1  IVSI  Interface 


The  IVSI  displayed  commands  only,  by  lighting  arrows  and  command  bars 
on  the  instrument  face.  The  positive  commands  were  represented  by  red 
arrows  in  the  center  of  the  instrument,  the  negative  horizontal  commands 
by  yellow  command  bars  in  the  lower  corners,  and  limit  commands  by  combina¬ 
tions  of  yellow  command  bars  at  the  edge  of  the  instrument  dial.  The  arrows 
and  command  bars  were  composed  of  combinations  of  LEDs,  and  each  arrow  or 
command  bar  was  tied  back  to  a  specific  pin  on  the  input  jack. 

Since  simple  relays  were  not  available  on  the  PDP-11  computer,  an 
interface  box  was  developed  to  translate  an  asynchronous  transmission  of 
characters  into  a  voltage  to  a  specific  pin  or  set  of  pins.  The  characters 
were  actually  a  coded  sequence  of  bits  representing  the  required  arrows  or 
command  bars  for  the  desired  command.  These  characters  were  clocked  in  by 
the  interface  box  and  interpreted  by  the  hardware  logic,  since  the  alarm 
also  required  a  simple  relay,  it  was  handled  in  the  same  manner. 

3 . 2  LED  Interface 


Litton  Aero  Products  provided  tremendous  assistance  in  developing  the 
LED  interface.  They  were  able  to  modify  their  prototype  display  to  accept 
asynchronous  transmission  directly  from  the  PDP-11.  The  device  accepted 
all  ASCII  characters  but  used  some  of  the  control  characters  for  color  and 
line  control. 

The  LED  display  presented  only  40  characters  (4  lines  of  10  characters 
each)  but  required  a  buffer  of  49  characters.  Characters  1,  2,  and  3  initial 
ized  the  device  and  restored  the  character  pointer  of  the  initial  character 
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hi. 


position,  characters  4,  15,  26,  and  37  provided  color  control  (red,  yellow, 
green,  no  color) ,  and  characters  48  and  49  represented  end  of  message.  The 
other  characters  were  displayed  as  transmitted. 

The  message  was  developed  in  the  main  loop  task  and  could  consist  of 
up  to  three  traffic  advisories,  a  traffic  advisory  and  a  command,  or  all 
blank  (to  clear  the  display) .  The  message  formats  are  discussed  in  Chapter 
Two,  Subsection  2.3.2. 

3.3  CRT  Interface 

The  CRT  display  is  actually  a  converted  TV  monitor  with  a  custom-made 
tube  used  to  provide  a  large  display  area.  Input  to  the  display  is  a  stan¬ 
dard  video  input.  An  interface  card  was  purchased  which  was  PDP-11  compat¬ 
ible  that  could  provide  a  composite  video  signal  from  a  matrix  array  of 
on-off  bits.  These  bits  represented  the  raster  dots  of  a  256  *  256  raster 
scan.  The  on-off  bits  were  stored  in  a  RAM  (Random- Access  Memory)  which 
was  addressed  through  registers  on  the  interface  card.  An  X  and  Y  address 
into  the  256  *  256  array  is  established.  A  third  register  is  used  to  indi¬ 
cate  whether  the  dot  is  to  be  lit  or  blanked.  By  lighting  and  blanking 
the  appropriate  raster  dots,  an  arbitrarily  complex  picture  could  be 
developed . 

The  software  interface  included  a  software  generator  which  represented 
characters  in  a  5  x  7  or  9  x  13  matrix  (the  smaller  size  was  used  for  the 
aircraft  data  blocks  and  the  larger  for  the  collision  avoidance  commands) . 
In  addition  to  the  alphanumerics,  there  were  special  symbols  representing 
ownship,  normal  traffic  and  intruder  traffic.  The  display  presentation  is 
described  in  Chapter  2,  Subsection  2.3.3. 


